-- Logs begin at Thu 2022-09-01 07:35:08 UTC, end at Thu 2022-09-01 08:46:30 UTC. -- Sep 01 08:00:12.349759 dv-cinder-855479-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 08:00:12.358637 dv-cinder-855479-1-smb devstack@keystone.service[81626]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 08:00:12 2022] *** Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: nodename: dv-cinder-855479-1-smb Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: machine: x86_64 Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: clock source: unix Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: pcre jit disabled Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: detected number of CPU cores: 4 Sep 01 08:00:12.360684 dv-cinder-855479-1-smb devstack@keystone.service[81626]: current working directory: / Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: detected binary path: /usr/bin/uwsgi-core Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: your processes number limit is 47680 Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: your memory page size is 4096 bytes Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: detected max file descriptor number: 2048 Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: lock engine: pthread robust mutexes Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: thunder lock: enabled Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 08:00:12.361314 dv-cinder-855479-1-smb devstack@keystone.service[81626]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 08:00:12.406021 dv-cinder-855479-1-smb devstack@keystone.service[81626]: Python main interpreter initialized at 0x55f5fb2b39c0 Sep 01 08:00:12.406021 dv-cinder-855479-1-smb devstack@keystone.service[81626]: python threads support enabled Sep 01 08:00:12.406021 dv-cinder-855479-1-smb devstack@keystone.service[81626]: your server socket listen backlog is limited to 100 connections Sep 01 08:00:12.406021 dv-cinder-855479-1-smb devstack@keystone.service[81626]: your mercy for graceful operations on workers is 90 seconds Sep 01 08:00:12.406539 dv-cinder-855479-1-smb devstack@keystone.service[81626]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 08:00:12.406539 dv-cinder-855479-1-smb devstack@keystone.service[81626]: *** Operational MODE: preforking *** Sep 01 08:00:12.406819 dv-cinder-855479-1-smb devstack@keystone.service[81626]: *** uWSGI is running in multiple interpreter mode *** Sep 01 08:00:12.406819 dv-cinder-855479-1-smb devstack@keystone.service[81626]: spawned uWSGI master process (pid: 81626) Sep 01 08:00:12.407034 dv-cinder-855479-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 08:00:12.407621 dv-cinder-855479-1-smb devstack@keystone.service[81626]: spawned uWSGI worker 1 (pid: 81642, cores: 1) Sep 01 08:00:12.410021 dv-cinder-855479-1-smb devstack@keystone.service[81626]: spawned uWSGI worker 2 (pid: 81643, cores: 1) Sep 01 08:00:12.410366 dv-cinder-855479-1-smb devstack@keystone.service[81626]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 08:00:16.914962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:16.914962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: from cryptography.utils import int_from_bytes Sep 01 08:00:16.915749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:16.915749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: from cryptography.utils import int_from_bytes Sep 01 08:00:16.919473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:16.919473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: from cryptography.utils import int_from_bytes Sep 01 08:00:16.919998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 08:00:16.919998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: from cryptography.utils import int_from_bytes Sep 01 08:00:16.968082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:00:16.968268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:00:16.968456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] command line args: [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:00:16.968726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:00:16.968908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ================================================================================ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:00:16.969161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] admin_token = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.969409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config_dir = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.969597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.969779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] config_source = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.969962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] debug = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.970164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.970460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 08:00:16.970526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 08:00:16.970593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.970722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] command line args: [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 08:00:16.970799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.970977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.971053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 08:00:16.971162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ================================================================================ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 08:00:16.971248 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.971413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] admin_token = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.971523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.971629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_config_append = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.971728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_dir = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.971821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.971924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_dir = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] config_source = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] debug = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.972935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_config_append = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.973946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_dir = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.974867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.975608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.975699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.975856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.975933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.976135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.976260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.976619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.976750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.976879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.976969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] publish_errors = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.977862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] standard_threads = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.978953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_journal = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] publish_errors = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_json = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_stderr = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] use_syslog = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.979913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.980086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.980169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.980326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.980402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.980567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] standard_threads = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.980650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.980803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.980881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.981051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.981127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.981231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.981308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.981409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_journal = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.981532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.981658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_json = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.981757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_stderr = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.981843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.981918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] use_syslog = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.981992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.982156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 08:00:16.982233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.982444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.982533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.982687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.982770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.982950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983194 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.983917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.984971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.985937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.986908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.987084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.987160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.987581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.987657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.987813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.987894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.988868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.989963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.990046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.990197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.990292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.990455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.990553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.990735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.990812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991869 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.991980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.992939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993033 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.993957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.994958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.995999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.996935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.997979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.998957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:16.999927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.000871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.001853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.002983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.003913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.004979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.005925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.006058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.006157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.external = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.006346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.006428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.006655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.006769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.006892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.password = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] auth.token = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.007917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.008905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.external = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.009868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.password = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] auth.token = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.010857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.011992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.012997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.013966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.014963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.015950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016679 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.016922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017860 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.017948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.018106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.018193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.018455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.018618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.018698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.018872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.018951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.019951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.020937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.021088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.021205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.021325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.021411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.021566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.021644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.022354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.022479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.022593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.022734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.022840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.023171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.023251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.023445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.023533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.023706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.023785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.023965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.024968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.025980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.026980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.027922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.028898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.029996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.030997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.031948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.032999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.033946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.034926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.035897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.036844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.039958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.040966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.041961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.042974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.043953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.044932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.045100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.045289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.045368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.045528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.045606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.045783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.045869 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.046884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.047854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.048932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.049997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.050160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.050258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.050428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.050506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.050750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.050828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.051997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.052963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.053618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.053861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.053995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.054155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.054309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.054416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.054637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.054726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.054887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.054974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.055965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.056942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.057888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.058885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.059031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.059110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.059274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.059351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.059511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.059597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.059670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81643) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:00:17.059781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.060031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.060271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.060513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.060755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.060998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.061246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.061486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.061738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.061976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.062227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.062488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.062736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.062969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.063213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.063451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 08:00:17.063623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81642) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 08:00:17.090233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.090499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.090731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.093923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.094160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.094433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.099230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.104607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.129032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.129257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.133401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.133637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.185870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.186847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.236784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.237024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.238130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.238389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.398253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.398541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.398695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.398918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.399138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.399354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.399527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.399766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.399998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.400223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.400446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.400666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.426510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.426714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.426952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.427187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.427402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.427618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.427834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.427917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.429672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.429672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.429672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.429672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.429672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.430588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.441320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.443489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.455715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.455893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.456991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81643) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.457074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81642) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 08:00:17.475248 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.475559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:17.475919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.476027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.476105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:17.476239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:17.476378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.476592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.476674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.476797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 08:00:17.476896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.477077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.477158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.477344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.477605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.477868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.486935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.487492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.487773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.487906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.488061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.488198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.488473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.488759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.495587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.496497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.498598 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.498895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.499187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.499477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.499559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.499763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.499844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.500964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.501124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.501203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.501391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.501469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.501667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.501946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.502217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.526471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.527147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.527972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.528260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.528650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.528938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.532916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.533204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.533493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.533574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.533799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.534090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.540113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.540403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.541021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.541318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.544494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.544792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.545083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.545364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.545448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.545639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.545720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.545938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.546227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.546548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.547859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.548172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.548466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.548723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.549026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.549309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.564680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.564968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.565522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.565810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.569561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.570614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.572733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.573035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.573771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.574070 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.577425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.578458 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.580595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.581587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.583727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.584036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.584392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.584688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.584975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.585063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.585324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.585406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.585614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.585904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.586209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.586632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.602010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.602336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.602610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.602886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.603525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.603830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.604102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.604384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.609674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.611176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.611381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.613123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.613311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.613444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.614710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.614996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.616285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.616577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.616870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.617160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.617446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.618063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.618381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.618682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.618975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.619263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.628820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.629112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.629401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.629687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.629976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.630286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.630581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.630707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.630897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.631729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.632157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.632646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.632943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.633227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.647071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.649465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.650179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.652631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.653138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.654623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.655606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.656107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.656402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.656698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.657065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.658654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.658948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.659236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.663505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.664917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.666225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.667730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.667877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.668152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.668440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.668722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.670717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.671025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.671317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.671609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.676885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.677194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.677484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.680854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.681171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.681457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.685353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81643) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.685663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.685955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.686272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.686541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.686819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.687105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.687385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.687669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.687942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.688225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.688494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.688632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81642) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 08:00:17.688816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.688943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.689072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81643) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.689200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.689336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.689580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.689867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.690143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.690440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.690736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.691010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.691293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.691602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.691833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.692095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81642) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 08:00:17.724508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f5fb2b39c0 pid: 81643 (default app) Sep 01 08:00:17.728329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f5fb2b39c0 pid: 81642 (default app) Sep 01 08:00:17.728613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d22de-00e9-4ba9-a65c-fd0b2ba9f44c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:17.728907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d22de-00e9-4ba9-a65c-fd0b2ba9f44c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:17.729184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d22de-00e9-4ba9-a65c-fd0b2ba9f44c None None] PATH_INFO: `/v3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:17.733461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Thu Sep 1 08:00:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:24.601262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159a5f-f076-4f52-a533-27edb730460c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:24.601795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159a5f-f076-4f52-a533-27edb730460c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:24.601795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4159a5f-f076-4f52-a533-27edb730460c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:24.606086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:24.611629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:24.612490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:24.612490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:24.684474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: INFO dbcounter [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] Registered counter for database keystone Sep 01 08:00:24.704453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG oslo_db.sqlalchemy.engines [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81643) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:00:24.711140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writer thread running {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:00:24.895987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG passlib.handlers.bcrypt [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81643) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 08:00:24.896286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG passlib.handlers.bcrypt [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81643) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 08:00:24.956124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:24.957757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:25.092730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 01 08:00:25.550754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4159a5f-f076-4f52-a533-27edb730460c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:25.621709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: INFO dbcounter [None req-e4159a5f-f076-4f52-a533-27edb730460c None None] Registered counter for database keystone Sep 01 08:00:25.643189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG oslo_db.sqlalchemy.engines [None req-e4159a5f-f076-4f52-a533-27edb730460c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81642) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 08:00:25.649564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writer thread running {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 08:00:25.778097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4159a5f-f076-4f52-a533-27edb730460c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:25.782454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162465ce-49ed-4dfa-a256-4804fea686c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:25.783079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162465ce-49ed-4dfa-a256-4804fea686c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:25.783363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162465ce-49ed-4dfa-a256-4804fea686c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:25.783636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162465ce-49ed-4dfa-a256-4804fea686c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:25.792437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162465ce-49ed-4dfa-a256-4804fea686c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:25.843888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING keystone.common.rbac_enforcer.enforcer [None req-162465ce-49ed-4dfa-a256-4804fea686c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 08:00:25.844157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162465ce-49ed-4dfa-a256-4804fea686c0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:25.854107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Sep 1 08:00:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 08:00:25.860221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:25.874996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101adbf7-89cc-4fb7-9d06-59d4fdf65b1b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:25.879435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40f635-0b41-4ba0-8da0-a065e03e9f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:25.880544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40f635-0b41-4ba0-8da0-a065e03e9f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:25.881353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40f635-0b41-4ba0-8da0-a065e03e9f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:25.881826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40f635-0b41-4ba0-8da0-a065e03e9f6f admin admin] PATH_INFO: `/v3/projects/7901ef731efb4e4d9c32801133aae298` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:25.883462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40f635-0b41-4ba0-8da0-a065e03e9f6f admin admin] RBAC: Authorizing `identity:get_project(project_id=7901ef731efb4e4d9c32801133aae298)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:25.937766 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4c40f635-0b41-4ba0-8da0-a065e03e9f6f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 08:00:25.938108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40f635-0b41-4ba0-8da0-a065e03e9f6f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:25.942822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Sep 1 08:00:25 2022] GET /identity/v3/projects/7901ef731efb4e4d9c32801133aae298 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:27.936305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9593-46b2-46f3-86b6-26ff27688c04 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:27.936815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9593-46b2-46f3-86b6-26ff27688c04 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:27.936815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9593-46b2-46f3-86b6-26ff27688c04 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:27.940923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:27.947045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64901ad-5d84-4aab-a89a-4a5d03e6d267 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:27.947473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64901ad-5d84-4aab-a89a-4a5d03e6d267 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:27.947600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64901ad-5d84-4aab-a89a-4a5d03e6d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:27.967793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c64901ad-5d84-4aab-a89a-4a5d03e6d267 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:27.969339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c64901ad-5d84-4aab-a89a-4a5d03e6d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:27.978119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 08:00:28.249279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9593-46b2-46f3-86b6-26ff27688c04 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:28.262667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9593-46b2-46f3-86b6-26ff27688c04 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:28.266914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6277de-56a4-424c-a533-1d2afd8ae3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:28.267525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6277de-56a4-424c-a533-1d2afd8ae3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:28.267809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6277de-56a4-424c-a533-1d2afd8ae3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:28.268083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6277de-56a4-424c-a533-1d2afd8ae3ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:28.276293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6277de-56a4-424c-a533-1d2afd8ae3ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:28.278082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6277de-56a4-424c-a533-1d2afd8ae3ed admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:28.287224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Sep 1 08:00:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:00:28.293017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64901ad-5d84-4aab-a89a-4a5d03e6d267 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:28.302176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64901ad-5d84-4aab-a89a-4a5d03e6d267 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:28.307111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e066f0c-dc9d-4722-9295-d50d3d77bb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:28.307744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066f0c-dc9d-4722-9295-d50d3d77bb69 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:28.308029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066f0c-dc9d-4722-9295-d50d3d77bb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:28.308305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e066f0c-dc9d-4722-9295-d50d3d77bb69 admin admin] PATH_INFO: `/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:28.309617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e066f0c-dc9d-4722-9295-d50d3d77bb69 admin admin] RBAC: Authorizing `identity:get_user(user_id=8d1271b1c1034e5fb48b3fb098c1b6b3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:28.311489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e066f0c-dc9d-4722-9295-d50d3d77bb69 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:28.313042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Sep 1 08:00:28 2022] GET /identity/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:30.327342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f6ac-55a5-4fb1-a8fd-1033046044fa None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:30.327892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f6ac-55a5-4fb1-a8fd-1033046044fa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:30.327892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356f6ac-55a5-4fb1-a8fd-1033046044fa None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:30.329210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:30.334842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc60c4-e63c-4d47-9c25-f4edae3fbaf0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:30.335246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc60c4-e63c-4d47-9c25-f4edae3fbaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:30.335480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc60c4-e63c-4d47-9c25-f4edae3fbaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:30.354327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bfbc60c4-e63c-4d47-9c25-f4edae3fbaf0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:30.355527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bfbc60c4-e63c-4d47-9c25-f4edae3fbaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:30.366506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54422be-2db9-4fa6-8394-1ce959e06f89 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:30.366794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54422be-2db9-4fa6-8394-1ce959e06f89 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:30.367102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54422be-2db9-4fa6-8394-1ce959e06f89 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:30.368511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:30.373978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:30.374288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:30.374571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:30.418300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG passlib.handlers.bcrypt [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81642) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 08:00:30.418696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG passlib.handlers.bcrypt [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81642) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 08:00:30.440561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:30.468962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:30.470599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:30.589858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:30.752132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc60c4-e63c-4d47-9c25-f4edae3fbaf0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:30.781828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:30.864955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:30.873383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc60c4-e63c-4d47-9c25-f4edae3fbaf0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:30.910997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:30.911640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:30.912588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:30.912941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:30.927235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:30.936795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:30.937771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:30.938631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:30.944655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:30.972658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b8496-3b04-42dd-8460-1bc2ec5c9868 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:30.976120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:31.015444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:31.016317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.016604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.016882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.030949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:31.051381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31513a-66b1-42e8-938f-28f76e25d118 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:31.087215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:31.088132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:31.088741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.088859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:31.089023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.089297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.089983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:31.090306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:31.091701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:31.109494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:31.116785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:31.207459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:00:31.213228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:31.216964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:31.223367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661267a-d82e-420e-84b6-d9ef85ac187b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:31.261909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:31.262581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.262857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.263129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] PATH_INFO: `/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.264317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] RBAC: Authorizing `identity:get_user(user_id=8d1271b1c1034e5fb48b3fb098c1b6b3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:31.265786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:31.267655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:31 2022] GET /identity/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:31.275215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:31.293822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:31.334002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac6b7f-d83b-4882-9861-ce95d758e9cc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:31.369771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:31.370574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.370848 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.371114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.385639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04714e5-73b8-4913-9d05-8c494c5213eb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:31.390786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:31.392302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:00:31.412883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:31.413794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:00:31.414603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:00:31.414603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:31.414603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:00:31.414603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:00:31.419823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:31.421282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:31.421923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.422204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.422501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.423629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:31.425095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:31.426701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:31.432889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:31.482028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:31.518025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:31.529239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbaf2a-9856-4710-b6a5-ab29bb05f6ab None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:31.539096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dea44e-6c6a-4161-ba02-f3b32791331e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:31.563755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0571d-ff2d-45f1-942b-14f3cff4e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:31.564372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0571d-ff2d-45f1-942b-14f3cff4e31b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.564659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0571d-ff2d-45f1-942b-14f3cff4e31b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.564937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0571d-ff2d-45f1-942b-14f3cff4e31b None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.565586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0571d-ff2d-45f1-942b-14f3cff4e31b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:31.565887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0571d-ff2d-45f1-942b-14f3cff4e31b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:31.567344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0571d-ff2d-45f1-942b-14f3cff4e31b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:31.573834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c84191-4585-47c8-a742-ff5a4f8dfd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:31.574479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84191-4585-47c8-a742-ff5a4f8dfd04 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:31.574764 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84191-4585-47c8-a742-ff5a4f8dfd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:31.575041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c84191-4585-47c8-a742-ff5a4f8dfd04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:31.575780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84191-4585-47c8-a742-ff5a4f8dfd04 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.domain.id=default, user.id=8d1271b1c1034e5fb48b3fb098c1b6b3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:31.576091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84191-4585-47c8-a742-ff5a4f8dfd04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:31.577530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c84191-4585-47c8-a742-ff5a4f8dfd04 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:31.585013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Sep 1 08:00:31 2022] GET /identity/v3/role_assignments?user.id=8d1271b1c1034e5fb48b3fb098c1b6b3&scope.domain.id=default&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:31.585772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:33.727827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b31af4-abf4-4d3b-9ff8-9ea416e88f55 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:33.728349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b31af4-abf4-4d3b-9ff8-9ea416e88f55 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:33.728349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b31af4-abf4-4d3b-9ff8-9ea416e88f55 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:33.729936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:33.735835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896c8c1-c615-4ee3-a8e2-9d7c1f1c7ec8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:33.736685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896c8c1-c615-4ee3-a8e2-9d7c1f1c7ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:33.737385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896c8c1-c615-4ee3-a8e2-9d7c1f1c7ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:33.759297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6896c8c1-c615-4ee3-a8e2-9d7c1f1c7ec8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:33.760762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6896c8c1-c615-4ee3-a8e2-9d7c1f1c7ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:33.794167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941bd4-ecf9-4dd2-be51-d4fb501c2341 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:33.794748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941bd4-ecf9-4dd2-be51-d4fb501c2341 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:33.795219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c941bd4-ecf9-4dd2-be51-d4fb501c2341 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:33.796728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 13/23] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:33.811758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04743262-8efc-4787-ba2b-b98de9d9301d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:33.812368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04743262-8efc-4787-ba2b-b98de9d9301d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:33.812841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04743262-8efc-4787-ba2b-b98de9d9301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:33.847328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-04743262-8efc-4787-ba2b-b98de9d9301d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:33.849045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04743262-8efc-4787-ba2b-b98de9d9301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:33.853836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 11/24] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:33.954439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 14/25] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:34.250158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896c8c1-c615-4ee3-a8e2-9d7c1f1c7ec8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:34.298959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:34.303550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62918143-0614-49ac-bf7b-2757f8950ae8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:34.304122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62918143-0614-49ac-bf7b-2757f8950ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:34.304598 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62918143-0614-49ac-bf7b-2757f8950ae8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:34.306272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 15/26] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:34.312508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcfcd1-c69d-492d-9bdc-54077894a95d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:34.313207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcfcd1-c69d-492d-9bdc-54077894a95d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:34.314896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcfcd1-c69d-492d-9bdc-54077894a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:34.350869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cedcfcd1-c69d-492d-9bdc-54077894a95d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:34.353067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cedcfcd1-c69d-492d-9bdc-54077894a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:34.398945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896c8c1-c615-4ee3-a8e2-9d7c1f1c7ec8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:34.472208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:34.473281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:34.473756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:34.474353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:34.490844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 16/27] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:34.492785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcfcd1-c69d-492d-9bdc-54077894a95d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:34.498101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:34.508613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:34.509517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:34.510299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:00:34.510883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:34.514823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 12/28] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:34.525151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:34.629885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcfcd1-c69d-492d-9bdc-54077894a95d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:34.673852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65c19f-705a-44c5-82d0-6f31f35770df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:34.674708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c19f-705a-44c5-82d0-6f31f35770df None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:34.674981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c19f-705a-44c5-82d0-6f31f35770df None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:34.675251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c19f-705a-44c5-82d0-6f31f35770df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:34.695876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65c19f-705a-44c5-82d0-6f31f35770df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:34.697414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65c19f-705a-44c5-82d0-6f31f35770df None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7d65c19f-705a-44c5-82d0-6f31f35770df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:00:34.726196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:34.727101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:00:34.728708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:00:34.728708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:00:34.728708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:34.728708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 17/29] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:34.728708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b719e-c88f-477d-9084-3d3fd8bcdf73 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:34.729059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b719e-c88f-477d-9084-3d3fd8bcdf73 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:34.729313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b719e-c88f-477d-9084-3d3fd8bcdf73 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:34.731625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 18/30] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:34.740193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34b7b3-7b33-4bbc-b26a-f1210b2df2d5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:34.740467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34b7b3-7b33-4bbc-b26a-f1210b2df2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:34.740885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34b7b3-7b33-4bbc-b26a-f1210b2df2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:34.747656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e8438-1640-4a9c-af37-100113367147 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:34.762176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5b34b7b3-7b33-4bbc-b26a-f1210b2df2d5 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:34.763470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:34.764892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5b34b7b3-7b33-4bbc-b26a-f1210b2df2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:34.824809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:34.825870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:34.828430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:34.828885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:34.834074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:34.834611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:34.836181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:34.862817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 13/31] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:34.866350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:34.868584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:34.886985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 19/32] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:34.888130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34b7b3-7b33-4bbc-b26a-f1210b2df2d5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:34.992328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73d115-ec97-435f-9a65-80dfd4a4bb76 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:35.031369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34b7b3-7b33-4bbc-b26a-f1210b2df2d5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:35.034131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:35.034792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.035078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.035371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.036073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:35.036426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:35.038805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:35.051655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 14/33] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:35.052950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:35.078022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:35.078953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.079246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.079517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] PATH_INFO: `/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.081342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] RBAC: Authorizing `identity:get_user(user_id=8d1271b1c1034e5fb48b3fb098c1b6b3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:35.083111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:35.084837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:35.086388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 20/34] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:34 2022] GET /identity/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:35.086944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:35.159167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:35.244778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d7d1f-d10f-45ac-ab4a-01090baeb7bc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:35.260688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdda6b3-e350-4838-bbe9-b58d20284dc2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:35.290886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:35.291732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.292012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.292287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.292965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:35.294861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:35.310621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:35.311246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.311581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.311859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.312571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:35.314161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:35.434049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 15/35] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Sep 1 08:00:35 2022] POST /identity/v3/roles => generated 225 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:35.434936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:35.467383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 21/36] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:00:35 2022] POST /identity/v3/projects => generated 301 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:35.468689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:35.550429 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:35.569930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef462-eda3-4ce6-9ff4-12860b10131f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:35.611623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc309705-f9e2-4363-9657-419d9ff35827 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:35.614045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2394bb-8cbd-47da-9ada-6f2401a39831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:35.614906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2394bb-8cbd-47da-9ada-6f2401a39831 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.615194 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2394bb-8cbd-47da-9ada-6f2401a39831 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.615469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2394bb-8cbd-47da-9ada-6f2401a39831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.617195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2394bb-8cbd-47da-9ada-6f2401a39831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:35.618896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2394bb-8cbd-47da-9ada-6f2401a39831 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:35.620817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:35.621680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 16/37] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:35.622886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a922ab-7c10-4bdd-a72d-be5ae9ae7a12 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.623207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a922ab-7c10-4bdd-a72d-be5ae9ae7a12 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.623485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a922ab-7c10-4bdd-a72d-be5ae9ae7a12 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.625766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 17/38] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:35.632137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a922ab-7c10-4bdd-a72d-be5ae9ae7a12 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:35.665091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf6e6b-de47-449b-9d03-9c431e96eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:35.665738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6e6b-de47-449b-9d03-9c431e96eb3c None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.666025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6e6b-de47-449b-9d03-9c431e96eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.666338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6e6b-de47-449b-9d03-9c431e96eb3c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.667266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf6e6b-de47-449b-9d03-9c431e96eb3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:35.670188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf6e6b-de47-449b-9d03-9c431e96eb3c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:35.689588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 22/39] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Sep 1 08:00:35 2022] POST /identity/v3/roles => generated 219 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:35.692089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f2057-4f6e-43af-aa3b-163737426072 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.692382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f2057-4f6e-43af-aa3b-163737426072 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.692720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f2057-4f6e-43af-aa3b-163737426072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.714532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-662f2057-4f6e-43af-aa3b-163737426072 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:35.716164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-662f2057-4f6e-43af-aa3b-163737426072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:35.777648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a922ab-7c10-4bdd-a72d-be5ae9ae7a12 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:35.822558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:35.823282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.823564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.824120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] PATH_INFO: `/v3/domains/default/users/8d1271b1c1034e5fb48b3fb098c1b6b3/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.827108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8d1271b1c1034e5fb48b3fb098c1b6b3, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:35.828674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 23/40] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:35.829554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:35.845737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d5442-e772-4875-aaf7-b98ec8866b04 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.845737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d5442-e772-4875-aaf7-b98ec8866b04 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.845737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d5442-e772-4875-aaf7-b98ec8866b04 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.847068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 24/41] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:35.856011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0863-d2e9-4bf4-9c78-583826fae273 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:35.856542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0863-d2e9-4bf4-9c78-583826fae273 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:35.856843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd0863-d2e9-4bf4-9c78-583826fae273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:35.861165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 18/42] 10.222.0.36 () {58 vars in 1361 bytes} [Thu Sep 1 08:00:35 2022] PUT /identity/v3/domains/default/users/8d1271b1c1034e5fb48b3fb098c1b6b3/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:00:36.001191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2dbd0863-d2e9-4bf4-9c78-583826fae273 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:36.002613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2dbd0863-d2e9-4bf4-9c78-583826fae273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:36.089073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 25/43] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:36.143020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:36.164773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:36.256895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b289d51-5f89-4551-9ef7-c96824668d0a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:36.292642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:36.293259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:36.293544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:36.293821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:36.294536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:36.295997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:36.311043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 19/44] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Sep 1 08:00:36 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:36.362010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0863-d2e9-4bf4-9c78-583826fae273 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:36.393492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:36.483778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd0863-d2e9-4bf4-9c78-583826fae273 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:36.521851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9737364-cc16-4b35-bbee-ed673cde1139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:36.522558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737364-cc16-4b35-bbee-ed673cde1139 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:36.522835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737364-cc16-4b35-bbee-ed673cde1139 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:36.523110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9737364-cc16-4b35-bbee-ed673cde1139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:36.524236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9737364-cc16-4b35-bbee-ed673cde1139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:36.525690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9737364-cc16-4b35-bbee-ed673cde1139 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:36.527523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 26/45] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:36.532938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:36.616013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:36.640273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eaecb-e6c4-4503-b4ac-55f514b635b5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:36.675041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030692e-b366-4e2d-bab6-0125793555f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:36.675656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030692e-b366-4e2d-bab6-0125793555f3 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:36.675942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030692e-b366-4e2d-bab6-0125793555f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:36.676222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030692e-b366-4e2d-bab6-0125793555f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:36.676877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030692e-b366-4e2d-bab6-0125793555f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:36.678455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030692e-b366-4e2d-bab6-0125793555f3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:36.706410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 20/46] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:00:36 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:37.857543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2929c3-91a3-42c9-b137-6d9b308efd51 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:37.858120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2929c3-91a3-42c9-b137-6d9b308efd51 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:37.858120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2929c3-91a3-42c9-b137-6d9b308efd51 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:37.859300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 27/47] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:37.865873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d729f4-76d2-48b8-b20c-0ddaa277b43b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:37.866460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d729f4-76d2-48b8-b20c-0ddaa277b43b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:37.866629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d729f4-76d2-48b8-b20c-0ddaa277b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:37.886084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e7d729f4-76d2-48b8-b20c-0ddaa277b43b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:37.887713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e7d729f4-76d2-48b8-b20c-0ddaa277b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:37.956833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 21/48] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:38.229586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2929c3-91a3-42c9-b137-6d9b308efd51 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:38.328206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:38.341133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2929c3-91a3-42c9-b137-6d9b308efd51 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:38.391744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:38.392646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.393033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.393418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.407130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:38.415484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:38.416414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:38.417134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:38.417674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 28/49] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:38.423402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d729f4-76d2-48b8-b20c-0ddaa277b43b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:38.487029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:38.534980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d729f4-76d2-48b8-b20c-0ddaa277b43b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:38.570931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0120380-5904-4bc7-9e42-c81e4f7f7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:38.571551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0120380-5904-4bc7-9e42-c81e4f7f7f47 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.571835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0120380-5904-4bc7-9e42-c81e4f7f7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.572113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0120380-5904-4bc7-9e42-c81e4f7f7f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.572791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0120380-5904-4bc7-9e42-c81e4f7f7f47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:38.573098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0120380-5904-4bc7-9e42-c81e4f7f7f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:38.574517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0120380-5904-4bc7-9e42-c81e4f7f7f47 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:38.582925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 22/50] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:38.589549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:38.668462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a570b-4586-4459-8ef0-1389bf7796f2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.668870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a570b-4586-4459-8ef0-1389bf7796f2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.669216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a570b-4586-4459-8ef0-1389bf7796f2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.670593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 23/51] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:00:38.675481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c732c01-8d94-47bc-91b2-e6e0984d480e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.675766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c732c01-8d94-47bc-91b2-e6e0984d480e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.676037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c732c01-8d94-47bc-91b2-e6e0984d480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.694690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0c732c01-8d94-47bc-91b2-e6e0984d480e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:38.695471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649c31b-36c1-4099-a797-b61b66d1d302 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:38.695884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0c732c01-8d94-47bc-91b2-e6e0984d480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:38.730418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:38.731078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.731358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.731630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] PATH_INFO: `/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.732753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] RBAC: Authorizing `identity:get_user(user_id=8d1271b1c1034e5fb48b3fb098c1b6b3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:38.734219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:38.736001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 29/52] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:38 2022] GET /identity/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:38.742786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:38.770111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:38.853228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd45e18-7fbe-4b53-8402-34ffb3a13ab1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:38.874470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 24/53] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:38.887651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:38.888287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:38.888567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:38.888845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:38.889953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:38.891435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:38.893143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 30/54] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:38.899707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c732c01-8d94-47bc-91b2-e6e0984d480e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:38.948542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:38.998710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c732c01-8d94-47bc-91b2-e6e0984d480e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:39.032321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:39.032934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:39.033210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:39.033480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:39.034217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.domain.id=default, user.id=8d1271b1c1034e5fb48b3fb098c1b6b3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:39.034554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:39.036014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:39.045026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 25/55] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Sep 1 08:00:38 2022] GET /identity/v3/role_assignments?user.id=8d1271b1c1034e5fb48b3fb098c1b6b3&scope.domain.id=default&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:39.148446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:39.247674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:39.263406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1718afc-bcd6-4c31-bc30-9cd6e6a1e51a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:39.301455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833bde0-ce33-486b-8adf-a1579d980496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:39.302102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833bde0-ce33-486b-8adf-a1579d980496 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:39.303078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833bde0-ce33-486b-8adf-a1579d980496 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:39.303357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833bde0-ce33-486b-8adf-a1579d980496 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:39.304559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833bde0-ce33-486b-8adf-a1579d980496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:39.306045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833bde0-ce33-486b-8adf-a1579d980496 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:39.307736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 31/56] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:39.313592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:39.419659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc3158-be87-430b-b765-e86c846aa765 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:39.434319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:39.454622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a384b89-afc1-47ba-9a11-9041558d109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:39.455230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384b89-afc1-47ba-9a11-9041558d109c None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:39.455510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384b89-afc1-47ba-9a11-9041558d109c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:39.455782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a384b89-afc1-47ba-9a11-9041558d109c None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:39.456470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a384b89-afc1-47ba-9a11-9041558d109c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:39.457907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a384b89-afc1-47ba-9a11-9041558d109c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:39.483485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 26/57] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Sep 1 08:00:39 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:41.442339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc18d5-19b0-4462-ad1d-7da908ccd17a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:41.443358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc18d5-19b0-4462-ad1d-7da908ccd17a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:41.443442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc18d5-19b0-4462-ad1d-7da908ccd17a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:41.444773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 32/58] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:41.449918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410a37-85c7-4fec-a134-a7b2a49be07f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:41.450312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410a37-85c7-4fec-a134-a7b2a49be07f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:41.450502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410a37-85c7-4fec-a134-a7b2a49be07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:41.469852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9c410a37-85c7-4fec-a134-a7b2a49be07f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:41.471101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9c410a37-85c7-4fec-a134-a7b2a49be07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:41.541369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 27/59] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:41.826858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc18d5-19b0-4462-ad1d-7da908ccd17a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:41.939181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc18d5-19b0-4462-ad1d-7da908ccd17a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:41.974818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdd8c1-6ec6-4482-a068-5085c61c4fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:41.975460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd8c1-6ec6-4482-a068-5085c61c4fac None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:41.975746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd8c1-6ec6-4482-a068-5085c61c4fac None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:41.976025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdd8c1-6ec6-4482-a068-5085c61c4fac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:41.977164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdd8c1-6ec6-4482-a068-5085c61c4fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:41.978652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdd8c1-6ec6-4482-a068-5085c61c4fac None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:41.980240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 33/60] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:41.986018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c410a37-85c7-4fec-a134-a7b2a49be07f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:42.081117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:42.087932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c410a37-85c7-4fec-a134-a7b2a49be07f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:42.124403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e8f86-423c-4c49-a850-d45d42157c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:42.125017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e8f86-423c-4c49-a850-d45d42157c8f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:42.125300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e8f86-423c-4c49-a850-d45d42157c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:42.125575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e8f86-423c-4c49-a850-d45d42157c8f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:42.126271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e8f86-423c-4c49-a850-d45d42157c8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:42.127737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e8f86-423c-4c49-a850-d45d42157c8f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:42.156408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 28/61] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:00:41 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:45.274147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0cd5-0e92-463e-8371-f7cb85d9b3ce None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:45.275203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0cd5-0e92-463e-8371-f7cb85d9b3ce None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:45.275733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd0cd5-0e92-463e-8371-f7cb85d9b3ce None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:45.277324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 34/62] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:45.283254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9315a-fe70-4185-9987-0528988f78cf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:45.284220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9315a-fe70-4185-9987-0528988f78cf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:45.284698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9315a-fe70-4185-9987-0528988f78cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:45.320425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-03e9315a-fe70-4185-9987-0528988f78cf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:45.322025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-03e9315a-fe70-4185-9987-0528988f78cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:45.362118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef45f82-d8fe-4bec-9df8-7edcae5f3228 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:45.362768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef45f82-d8fe-4bec-9df8-7edcae5f3228 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:45.363242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef45f82-d8fe-4bec-9df8-7edcae5f3228 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:45.365564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 35/63] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:45.372124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f8a7c-0fb9-44bd-bba1-2e9d469c8c56 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:45.372874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f8a7c-0fb9-44bd-bba1-2e9d469c8c56 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:45.373438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f8a7c-0fb9-44bd-bba1-2e9d469c8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:45.421290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dc8f8a7c-0fb9-44bd-bba1-2e9d469c8c56 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:45.422557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dc8f8a7c-0fb9-44bd-bba1-2e9d469c8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:45.467645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 29/64] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:45.475112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:45.529427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 36/65] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:45.843811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9315a-fe70-4185-9987-0528988f78cf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:45.864103 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e363-2653-4308-ace4-f1b7fc9748ca None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:45.865919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e363-2653-4308-ace4-f1b7fc9748ca None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:45.866440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e363-2653-4308-ace4-f1b7fc9748ca None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:45.868256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 37/66] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:45.880443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce51cd8-705e-4199-accb-2d6cf543f59d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:45.881015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce51cd8-705e-4199-accb-2d6cf543f59d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:45.881791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce51cd8-705e-4199-accb-2d6cf543f59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:45.917256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9ce51cd8-705e-4199-accb-2d6cf543f59d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:45.920534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9ce51cd8-705e-4199-accb-2d6cf543f59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:45.977366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:46.000282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9315a-fe70-4185-9987-0528988f78cf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.025294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 38/67] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:46.027149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce51cd8-705e-4199-accb-2d6cf543f59d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.054403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942640f-bebd-47f8-853a-b85c1cb9295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:46.055120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942640f-bebd-47f8-853a-b85c1cb9295e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.055537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942640f-bebd-47f8-853a-b85c1cb9295e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.055813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942640f-bebd-47f8-853a-b85c1cb9295e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.070505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942640f-bebd-47f8-853a-b85c1cb9295e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d942640f-bebd-47f8-853a-b85c1cb9295e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:46.076946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:46.078562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:46.079992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:00:46.083205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 30/68] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:46.086890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b7339-66ef-425b-bed0-e77150b8890b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.087186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b7339-66ef-425b-bed0-e77150b8890b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.087467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b7339-66ef-425b-bed0-e77150b8890b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.089313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 31/69] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:46.090554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b7339-66ef-425b-bed0-e77150b8890b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.187308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:46.213605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce51cd8-705e-4199-accb-2d6cf543f59d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.262485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b7339-66ef-425b-bed0-e77150b8890b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.274667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4395e4-b848-4bec-8fc3-8373c20eec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:46.275802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4395e4-b848-4bec-8fc3-8373c20eec3b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.276311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4395e4-b848-4bec-8fc3-8373c20eec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.276788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4395e4-b848-4bec-8fc3-8373c20eec3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.300198 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4395e4-b848-4bec-8fc3-8373c20eec3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9e4395e4-b848-4bec-8fc3-8373c20eec3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:46.311328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:46.313225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:46.315301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 39/70] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:46.316546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cff76f-ae94-4a9f-b804-5e290f084844 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.316546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cff76f-ae94-4a9f-b804-5e290f084844 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.317573 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cff76f-ae94-4a9f-b804-5e290f084844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.329477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4278c6-ab69-45c5-8616-7b474781a81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:46.330524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4278c6-ab69-45c5-8616-7b474781a81b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.330524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4278c6-ab69-45c5-8616-7b474781a81b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.330993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4278c6-ab69-45c5-8616-7b474781a81b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.331328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4278c6-ab69-45c5-8616-7b474781a81b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:46.331632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4278c6-ab69-45c5-8616-7b474781a81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:46.333617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4278c6-ab69-45c5-8616-7b474781a81b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:46.339292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b2cff76f-ae94-4a9f-b804-5e290f084844 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:46.341028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b2cff76f-ae94-4a9f-b804-5e290f084844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:46.343478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 32/71] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:46.344734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c4b7-ce86-4a33-b42e-8c4ad3ee9230 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.346006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c4b7-ce86-4a33-b42e-8c4ad3ee9230 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.346006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6c4b7-ce86-4a33-b42e-8c4ad3ee9230 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.353313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 33/72] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:46.353313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c4b7-ce86-4a33-b42e-8c4ad3ee9230 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.360620 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:46.424333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 40/73] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:46.424333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cff76f-ae94-4a9f-b804-5e290f084844 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.488904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6c4b7-ce86-4a33-b42e-8c4ad3ee9230 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.529141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb555f-fe67-4871-9d9f-c0ebe29ea72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:46.530005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb555f-fe67-4871-9d9f-c0ebe29ea72a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.530110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb555f-fe67-4871-9d9f-c0ebe29ea72a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.530345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb555f-fe67-4871-9d9f-c0ebe29ea72a None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.531032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb555f-fe67-4871-9d9f-c0ebe29ea72a None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:46.531380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb555f-fe67-4871-9d9f-c0ebe29ea72a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:46.532757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb555f-fe67-4871-9d9f-c0ebe29ea72a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:46.542652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 34/74] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:46.548537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fd625-0ba8-4179-839e-bd8d4e07de70 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.548831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fd625-0ba8-4179-839e-bd8d4e07de70 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.549112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fd625-0ba8-4179-839e-bd8d4e07de70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.557204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:46.569916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f76fd625-0ba8-4179-839e-bd8d4e07de70 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:46.571209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f76fd625-0ba8-4179-839e-bd8d4e07de70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:46.599336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cff76f-ae94-4a9f-b804-5e290f084844 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.641212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:46.641872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.642319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.642581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] PATH_INFO: `/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.643767 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] RBAC: Authorizing `identity:get_user(user_id=8d1271b1c1034e5fb48b3fb098c1b6b3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:46.645255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:46.647470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 41/75] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:46.648280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.664465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:46.678076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 35/76] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:46.678926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fd625-0ba8-4179-839e-bd8d4e07de70 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.777348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92023eca-90c7-4ed5-9c88-892f53c576f1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.823331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fd625-0ba8-4179-839e-bd8d4e07de70 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.824837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:46.825765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.826055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.826374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.842917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:46.851177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:46.852094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:46.852852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 42/77] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:46.853463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.863420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:46.878114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:46.879409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:46.879931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:46.880810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:46.902205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:46.903734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:46.905615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 36/78] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:46.906224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:46.984032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e7d82-dba7-4393-a538-2f59e20ac089 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:46.986293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.021869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.022553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.022836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.023119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.056099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5643-3870-4532-b183-a684ea5e0a99 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.098430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.099414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.100845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.101436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.101809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.102174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.103097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:47.103494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.103813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.105703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.116931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 37/79] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:47.117804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.217825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 43/80] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:00:47.219145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.234668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b790b-ce7d-4a1d-aab0-e8a8edf8507d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.252773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.273738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.274420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.274699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.274977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.286360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:47.292323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:47.293589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 38/81] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:47.295907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.338504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79081c0d-eff5-46e8-8f17-c29c83414c98 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.341059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.379028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.379664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.379957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.380746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.408425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bd3e7-ace3-41a7-87cd-1cb1dbf56405 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.447473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.448116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.448405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.448682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.449865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.451406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.454287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 39/82] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:47.454287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.459723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.461336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.511573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.575366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1358e-fa14-4e84-9ed0-9fc1e612f356 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.579376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 44/83] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:00:47.580244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.589185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.620022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.620879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.621352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.621682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.623531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.625268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.627205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 40/84] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:47.628116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.712431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c857e-3b39-453e-820e-ca6a8a4e3ed8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.749176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33f52-e3f3-4ea5-9415-7b8fda688d09 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.752641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.753285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.753567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.753847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.755049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.757006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.758745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 45/85] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:47.759516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.763933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.789276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.790029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.790356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.790637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.791335 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:47.791641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.793038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.805163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 41/86] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:47.810552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.838743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:47.875024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532e813-ba2f-4cd2-a34a-fd71a9035867 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.921075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.921709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.922015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.922311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.922984 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.924441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.925765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6950c-43c1-454f-8d66-7a2ab5ec19b5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:47.957535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 46/87] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:00:47 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:47.959050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:47.966618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:47.967323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:47.967611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:47.967886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:47.969180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:47.970754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:47.972688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 42/88] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:47.973552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.041677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:48.117099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b2fdc-3424-4c9e-a604-c3bfc5fd8955 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.124151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7cd3a-6a37-4ef1-988e-ee56d9c55c6a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.160227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:48.173043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.173783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.174209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.174611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.176017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=8d1271b1c1034e5fb48b3fb098c1b6b3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:48.176173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.176337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.176469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.176469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.176739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.177905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.184431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 43/89] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/role_assignments?user.id=8d1271b1c1034e5fb48b3fb098c1b6b3&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:48.185286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.299439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.301112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.389964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ecd36-6405-42c7-9b0f-b61cb824602b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.399199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:48.440088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.440702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.440915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.441197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.442767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.444059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 47/90] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:00:48.444481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.445594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.445835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 44/91] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:48 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:48.451554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.498768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:48.573122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d96dcf-b5d7-4657-9250-7400b371a68b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.617910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.618959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.619448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.619922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.620909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=77862a319a1646ef8dc2149d2122db07) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:48.621443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.623188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.629719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 48/92] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:00:48 2022] GET /identity/v3/role_assignments?user.id=77862a319a1646ef8dc2149d2122db07&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=2d6361445523491fb757e0b12f225dcb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:48.631133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.769117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:48.782711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e736d-305c-405c-b869-a5b8bdf65fcb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.813800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c531e-fb2e-4528-a58e-9dbdfd74cb4c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:48.856986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.858292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.858808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.859284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.904253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:48.904924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:48.905208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:48.905488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:48.906816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.908455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:48.910209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 45/93] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:48 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:48.917356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:48.953494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:48.956365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:49.014468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:49.174768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:49.191857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 49/94] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:00:49.198231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:49.222128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776ce58-d4d7-4559-80c0-741d97d9e009 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:49.291207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:49.291850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.292143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.292430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.293219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] RBAC: Adding query filter params (role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=77862a319a1646ef8dc2149d2122db07) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:49.293671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:49.295325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:49.307983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 46/95] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:00:48 2022] GET /identity/v3/role_assignments?user.id=77862a319a1646ef8dc2149d2122db07&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 259 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:49.414782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6293b-33b0-4c57-81a2-bac187763251 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:49.459890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452bac9-a6d7-44ff-ad8f-be924c0de92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:49.460834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bac9-a6d7-44ff-ad8f-be924c0de92a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.460834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bac9-a6d7-44ff-ad8f-be924c0de92a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.461077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452bac9-a6d7-44ff-ad8f-be924c0de92a None admin] PATH_INFO: `/v3/projects/87bb387986a948ccbdfaf520340fd21a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.462210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bac9-a6d7-44ff-ad8f-be924c0de92a None admin] RBAC: Authorizing `identity:get_project(project_id=87bb387986a948ccbdfaf520340fd21a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:49.463817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452bac9-a6d7-44ff-ad8f-be924c0de92a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:49.465830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 50/96] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:49 2022] GET /identity/v3/projects/87bb387986a948ccbdfaf520340fd21a => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:49.471942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:49.633819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ee81d-6ecf-4d0e-9ac8-1b3f8a55074a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:49.645393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:49.688396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa35124-8df9-4994-a862-357929a761f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:49.689020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa35124-8df9-4994-a862-357929a761f4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:49.689301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa35124-8df9-4994-a862-357929a761f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:49.689571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa35124-8df9-4994-a862-357929a761f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:49.690358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa35124-8df9-4994-a862-357929a761f4 None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=87bb387986a948ccbdfaf520340fd21a, user.id=77862a319a1646ef8dc2149d2122db07) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:49.690672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa35124-8df9-4994-a862-357929a761f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:49.692177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa35124-8df9-4994-a862-357929a761f4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:49.703361 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 47/97] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:00:49 2022] GET /identity/v3/role_assignments?user.id=77862a319a1646ef8dc2149d2122db07&scope.project.id=87bb387986a948ccbdfaf520340fd21a&role.id=2d6361445523491fb757e0b12f225dcb => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:51.249599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c8118-e145-402b-bbc4-745fa6f28f95 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:51.250135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c8118-e145-402b-bbc4-745fa6f28f95 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:51.250135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c8118-e145-402b-bbc4-745fa6f28f95 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:51.251871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 51/98] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:51.258878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff10b-ec99-459b-8cd8-0784f638e8bb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:51.259389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff10b-ec99-459b-8cd8-0784f638e8bb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:51.259458 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ff10b-ec99-459b-8cd8-0784f638e8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:51.280762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-803ff10b-ec99-459b-8cd8-0784f638e8bb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:51.282050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-803ff10b-ec99-459b-8cd8-0784f638e8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:51.391337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 48/99] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:51.664734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215e97-4787-493d-b16e-d4f0870caf89 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:51.665360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215e97-4787-493d-b16e-d4f0870caf89 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:51.665829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50215e97-4787-493d-b16e-d4f0870caf89 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:51.667888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 52/100] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:51.673147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69df2a-67f8-4f5f-9758-2130a231e7ce None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:51.673444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69df2a-67f8-4f5f-9758-2130a231e7ce None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:51.673731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69df2a-67f8-4f5f-9758-2130a231e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:51.704527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fd69df2a-67f8-4f5f-9758-2130a231e7ce None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:51.705749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fd69df2a-67f8-4f5f-9758-2130a231e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:51.803245 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 49/101] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:51.881263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215e97-4787-493d-b16e-d4f0870caf89 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:51.957847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:52.018089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50215e97-4787-493d-b16e-d4f0870caf89 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:52.055763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48167f74-250c-45e8-bf97-49206e692694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:52.056398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167f74-250c-45e8-bf97-49206e692694 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.056676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167f74-250c-45e8-bf97-49206e692694 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.056947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48167f74-250c-45e8-bf97-49206e692694 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.073616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48167f74-250c-45e8-bf97-49206e692694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-48167f74-250c-45e8-bf97-49206e692694 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:52.078594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:52.079501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:52.080227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 53/102] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:52.087375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69df2a-67f8-4f5f-9758-2130a231e7ce None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:52.089019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa63c4-6a09-4a65-880a-3d1a6aba7a2d None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.089300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa63c4-6a09-4a65-880a-3d1a6aba7a2d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.089574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa63c4-6a09-4a65-880a-3d1a6aba7a2d None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.090978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 54/103] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:52.096463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7582b4-f342-4a83-9e8d-89448f2896b6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.096744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7582b4-f342-4a83-9e8d-89448f2896b6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.097021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7582b4-f342-4a83-9e8d-89448f2896b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.122206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1a7582b4-f342-4a83-9e8d-89448f2896b6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:52.123543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a7582b4-f342-4a83-9e8d-89448f2896b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:52.153317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:52.236013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 55/104] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:52.271341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7582b4-f342-4a83-9e8d-89448f2896b6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:52.290687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69df2a-67f8-4f5f-9758-2130a231e7ce None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:52.328807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18beafe-426b-482e-b331-3350431457ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:52.329678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18beafe-426b-482e-b331-3350431457ac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.330109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18beafe-426b-482e-b331-3350431457ac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.330548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18beafe-426b-482e-b331-3350431457ac None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.331391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18beafe-426b-482e-b331-3350431457ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:52.331877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18beafe-426b-482e-b331-3350431457ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:52.334391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18beafe-426b-482e-b331-3350431457ac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:52.344667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 50/105] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:52.351026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18beafe-426b-482e-b331-3350431457ac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:52.359990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:52.452807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:52.464750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18beafe-426b-482e-b331-3350431457ac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:52.471811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7582b4-f342-4a83-9e8d-89448f2896b6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:52.523148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc5e5-b77b-4c8e-9127-6f0336006250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:52.524035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc5e5-b77b-4c8e-9127-6f0336006250 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.524491 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc5e5-b77b-4c8e-9127-6f0336006250 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.524928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc5e5-b77b-4c8e-9127-6f0336006250 None admin] PATH_INFO: `/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.533431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbc5e5-b77b-4c8e-9127-6f0336006250 None admin] RBAC: Authorizing `identity:get_user(user_id=8d1271b1c1034e5fb48b3fb098c1b6b3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:52.533431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbc5e5-b77b-4c8e-9127-6f0336006250 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:52.533625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 51/106] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:52 2022] GET /identity/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:52.535303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9c0be-fc40-4edf-ab53-c0ce8aa000b3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.535587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9c0be-fc40-4edf-ab53-c0ce8aa000b3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.535863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9c0be-fc40-4edf-ab53-c0ce8aa000b3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.540130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3c739-0b70-40c7-827d-e280b7d68089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:52.540779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c739-0b70-40c7-827d-e280b7d68089 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.541131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c739-0b70-40c7-827d-e280b7d68089 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.541408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3c739-0b70-40c7-827d-e280b7d68089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.541994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 52/107] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:52.543035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9c0be-fc40-4edf-ab53-c0ce8aa000b3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:52.573085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3c739-0b70-40c7-827d-e280b7d68089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-16e3c739-0b70-40c7-827d-e280b7d68089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:52.595927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:52.597657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:52.600418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 56/108] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:52.610348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b800b3-e320-4724-b55e-87db5bb45a5c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.610348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b800b3-e320-4724-b55e-87db5bb45a5c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.610348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b800b3-e320-4724-b55e-87db5bb45a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.636271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b6b800b3-e320-4724-b55e-87db5bb45a5c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:52.637890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b6b800b3-e320-4724-b55e-87db5bb45a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:52.742415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 57/109] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:52.742415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b800b3-e320-4724-b55e-87db5bb45a5c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:52.756501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9c0be-fc40-4edf-ab53-c0ce8aa000b3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:52.781718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:52.796606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:52.797399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.797843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.798126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.799318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:52.801029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:52.808962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 53/110] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:52 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:52.810153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:52.848333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:52.858388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b800b3-e320-4724-b55e-87db5bb45a5c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:52.907084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c70e8-10bc-4cdb-bad9-3bc8182f42d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:52.908203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c70e8-10bc-4cdb-bad9-3bc8182f42d3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.908629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c70e8-10bc-4cdb-bad9-3bc8182f42d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.909298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c70e8-10bc-4cdb-bad9-3bc8182f42d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.910660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c70e8-10bc-4cdb-bad9-3bc8182f42d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:52.911427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c70e8-10bc-4cdb-bad9-3bc8182f42d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:52.913261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c70e8-10bc-4cdb-bad9-3bc8182f42d3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:52.927571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 58/111] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:00:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:52.929171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb780-ad1d-4b04-8d89-a44d280107a1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.929650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb780-ad1d-4b04-8d89-a44d280107a1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.930066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb780-ad1d-4b04-8d89-a44d280107a1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.931515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 59/112] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:52.936026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd562f-c0a3-404a-be91-db1877ba3e06 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:52.936495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceb780-ad1d-4b04-8d89-a44d280107a1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:52.983402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:52.984110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:52.984390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:52.985202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:52.987237 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:52.989202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:52.991831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 54/113] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:52.992878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.062924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceb780-ad1d-4b04-8d89-a44d280107a1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.064541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:53.101330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd825f5-5e90-4348-8388-1e939dc32d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:53.102005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd825f5-5e90-4348-8388-1e939dc32d0d None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.102317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd825f5-5e90-4348-8388-1e939dc32d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.102599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd825f5-5e90-4348-8388-1e939dc32d0d None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/8d1271b1c1034e5fb48b3fb098c1b6b3/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.104534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd825f5-5e90-4348-8388-1e939dc32d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc875dd0aa549dca8f19d0ce581bb84, user_id=8d1271b1c1034e5fb48b3fb098c1b6b3, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:53.105999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd825f5-5e90-4348-8388-1e939dc32d0d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:53.111474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:53.119621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d401ea-e0b1-44e1-becc-17a83343201b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.122058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 60/114] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:00:52 2022] PUT /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/8d1271b1c1034e5fb48b3fb098c1b6b3/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:00:53.123076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3f59b-67eb-4cdc-9534-925fd809c5dc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.123366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3f59b-67eb-4cdc-9534-925fd809c5dc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.123640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3f59b-67eb-4cdc-9534-925fd809c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.144432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-eea3f59b-67eb-4cdc-9534-925fd809c5dc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:53.146274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eea3f59b-67eb-4cdc-9534-925fd809c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:53.165141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:53.165793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.166077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.166413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] PATH_INFO: `/v3/users/6d7ab6ad36b0433795e468aebc4dbbc9` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.182498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] RBAC: Authorizing `identity:get_user(user_id=6d7ab6ad36b0433795e468aebc4dbbc9)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:53.183984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:53.185744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 55/115] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:52 2022] GET /identity/v3/users/6d7ab6ad36b0433795e468aebc4dbbc9 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:53.187708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.242275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 61/116] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:53.242275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3f59b-67eb-4cdc-9534-925fd809c5dc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.351093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9819-5561-4ead-aaa3-177aee29f506 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.363188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:53.374009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3f59b-67eb-4cdc-9534-925fd809c5dc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.400326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb131e-9c01-4d96-abbd-ce23e85b1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:53.400978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb131e-9c01-4d96-abbd-ce23e85b1bb6 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.401263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb131e-9c01-4d96-abbd-ce23e85b1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.401540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb131e-9c01-4d96-abbd-ce23e85b1bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.402347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb131e-9c01-4d96-abbd-ce23e85b1bb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:53.403945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb131e-9c01-4d96-abbd-ce23e85b1bb6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:53.415457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b89623-5015-439c-b61b-a99d78f0b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:53.416216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89623-5015-439c-b61b-a99d78f0b213 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.416504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89623-5015-439c-b61b-a99d78f0b213 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.416790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89623-5015-439c-b61b-a99d78f0b213 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.429982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b89623-5015-439c-b61b-a99d78f0b213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-99b89623-5015-439c-b61b-a99d78f0b213 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:53.435273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:53.436410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:53.437300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 62/117] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:53.438332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4ef7e-506d-4e89-b0c3-068f5127ec84 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.438424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4ef7e-506d-4e89-b0c3-068f5127ec84 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.443112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4ef7e-506d-4e89-b0c3-068f5127ec84 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.443112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 63/118] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:53.443112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4ef7e-506d-4e89-b0c3-068f5127ec84 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.448520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 56/119] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:00:53 2022] POST /identity/v3/projects => generated 302 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:53.450127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e878f-0ec5-4695-925f-5a497c769e6a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.450582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e878f-0ec5-4695-925f-5a497c769e6a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.450998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e878f-0ec5-4695-925f-5a497c769e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.487316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:53.496332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-690e878f-0ec5-4695-925f-5a497c769e6a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:53.497643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-690e878f-0ec5-4695-925f-5a497c769e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:53.603442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 57/120] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:53.604630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e878f-0ec5-4695-925f-5a497c769e6a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.636847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4ef7e-506d-4e89-b0c3-068f5127ec84 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.691020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:53.691664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.691945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.692222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.733403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:53.743984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e878f-0ec5-4695-925f-5a497c769e6a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.795062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:53.795886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:53.796588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:53.796867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:53.797983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:53.798314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:53.800454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:53.804113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:53.812666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 58/121] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:53.815204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:53.820504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:53.822028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:53.932492 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc2c81-fb12-48b5-89ab-3457619cedec None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:53.932657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 64/122] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:00:53.933458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.003044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.003701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.003988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.004265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.029009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:54.039737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:54.040819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:00:54.041731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:00:54.042324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.044681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 59/123] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:54.045815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.105682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc484dc2-0230-4cce-bb61-a520594947bb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.139502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.161887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.162882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.163302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.163712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.165863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.167553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.170648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 65/124] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:53 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.171613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.216250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c9b96-7624-4160-b8ac-7417d7f35c66 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.274976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.276007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.276497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.276882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.278611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.280842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.283061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 60/125] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.290520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.307363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755432ce-8f04-4b3a-a6b2-fd6077a4996b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.350632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.358684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.359618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.360047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.360468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.377180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:54.384465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:54.385568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:54.386475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:54.389303 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 66/126] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:54.395316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.465099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403128b4-e75e-4c5c-9948-a0a5dadf6bff None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.506855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.522143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.522880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.523175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.523480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.524152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:54.524461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.525936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.535161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 61/127] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.536143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.553891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9fc6-5ec5-4af2-87b2-ced2416f577d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.600148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.601866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.602408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.602939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.604562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.607049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.608916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 67/128] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.609548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.669540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd286b-e184-44c4-867c-ae0165f65fb3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.674633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.725388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.726688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.727183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.727659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.729570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] RBAC: Adding query filter params (role.id=a90fc9cb49094b28b26944892f24382b, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=6d7ab6ad36b0433795e468aebc4dbbc9) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:54.730120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.733059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.736014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb56c2a-3037-4a02-8d23-d478c5134827 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.744349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 62/129] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/role_assignments?user.id=6d7ab6ad36b0433795e468aebc4dbbc9&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=a90fc9cb49094b28b26944892f24382b => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.745982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.808158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.808741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.809029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.809318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.810008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:54.810438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.811878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.824465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:54.833807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 68/130] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.842393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:54.916851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf3d2-a870-4b1d-bcfc-c47b3ecfa35f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:54.959227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:54.959898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:54.960252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:54.960536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:54.961814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:54.963389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:54.966636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 63/131] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:54.966636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:55.080195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b187763-43df-4dc9-8d1e-3059d1a615c0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:55.092034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c4b13-34d5-45c3-844d-9fa79c5634ef None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:55.101546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:55.138133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:55.143045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:55.143736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.144028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.144353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.146962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:55.148758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:55.152141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 64/132] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:54 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:55.153339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:55.154027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.154338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.154626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/77862a319a1646ef8dc2149d2122db07/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.156261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:55.158066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc875dd0aa549dca8f19d0ce581bb84, user_id=77862a319a1646ef8dc2149d2122db07, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:55.159572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:55.185616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 69/133] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:00:54 2022] PUT /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/77862a319a1646ef8dc2149d2122db07/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:00:55.186638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:55.382400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf9174-e452-4fee-a3f3-c9e58bdd0180 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:55.398839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c248c3-6ab8-47ac-9b8e-b5a08a9751d1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:55.458447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:55.458868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:55.459111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.459399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.459677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] PATH_INFO: `/v3/projects/87bb387986a948ccbdfaf520340fd21a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.460397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.460938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.461421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.462847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:55.464529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:55.466736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 65/134] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:55 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:55.467286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] RBAC: Authorizing `identity:get_project(project_id=87bb387986a948ccbdfaf520340fd21a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:55.473489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:55.473489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 70/135] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:55 2022] GET /identity/v3/projects/87bb387986a948ccbdfaf520340fd21a => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:55.479050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:55.479245 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:55.558641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:55.564654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:55.614015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daa57d-5ef1-401b-9a26-3e08582f5104 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:55.621327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5ec59-7a63-406b-989a-621a21f07879 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:55.655041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26185317-dfe6-4896-9495-94d467c373f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:55.656036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185317-dfe6-4896-9495-94d467c373f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.656520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185317-dfe6-4896-9495-94d467c373f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.656993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26185317-dfe6-4896-9495-94d467c373f5 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/77862a319a1646ef8dc2149d2122db07/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.659373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26185317-dfe6-4896-9495-94d467c373f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc875dd0aa549dca8f19d0ce581bb84, user_id=77862a319a1646ef8dc2149d2122db07, role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:55.661646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26185317-dfe6-4896-9495-94d467c373f5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:55.663926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff60181-eea0-40c4-9a08-957777c3ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:55.664795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60181-eea0-40c4-9a08-957777c3ad7e None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.665078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60181-eea0-40c4-9a08-957777c3ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.665353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff60181-eea0-40c4-9a08-957777c3ad7e None admin] PATH_INFO: `/v3/projects/87bb387986a948ccbdfaf520340fd21a/users/77862a319a1646ef8dc2149d2122db07/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.668138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff60181-eea0-40c4-9a08-957777c3ad7e None admin] RBAC: Authorizing `identity:create_grant(project_id=87bb387986a948ccbdfaf520340fd21a, user_id=77862a319a1646ef8dc2149d2122db07, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:55.669736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff60181-eea0-40c4-9a08-957777c3ad7e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:55.685250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 66/136] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:00:55 2022] PUT /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/77862a319a1646ef8dc2149d2122db07/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:00:55.687269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bdd5a-fcb2-4a06-b9d8-0f7b785be9b0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.687790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bdd5a-fcb2-4a06-b9d8-0f7b785be9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.688451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bdd5a-fcb2-4a06-b9d8-0f7b785be9b0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.690617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 67/137] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:55.699936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2102-b186-48e6-a195-cc7861ea37fe None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:55.700681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2102-b186-48e6-a195-cc7861ea37fe None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:55.701190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2102-b186-48e6-a195-cc7861ea37fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:55.717701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 71/138] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:00:55 2022] PUT /identity/v3/projects/87bb387986a948ccbdfaf520340fd21a/users/77862a319a1646ef8dc2149d2122db07/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:00:55.741641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0fff2102-b186-48e6-a195-cc7861ea37fe None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:55.742938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0fff2102-b186-48e6-a195-cc7861ea37fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:55.838915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 68/139] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:56.022160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8c93-0ea4-4a7f-ad0f-85354aeaed9b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.022160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8c93-0ea4-4a7f-ad0f-85354aeaed9b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.022160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed8c93-0ea4-4a7f-ad0f-85354aeaed9b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.022647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 72/140] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:56.028670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d575-c50c-43c6-afee-d9172354ec75 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.029158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d575-c50c-43c6-afee-d9172354ec75 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.029593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403d575-c50c-43c6-afee-d9172354ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.050842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c403d575-c50c-43c6-afee-d9172354ec75 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:56.052254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c403d575-c50c-43c6-afee-d9172354ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:56.108348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:56.137861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 69/141] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:56.183746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed8c93-0ea4-4a7f-ad0f-85354aeaed9b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:56.319785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:56.324204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed8c93-0ea4-4a7f-ad0f-85354aeaed9b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:56.379922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:56.380571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.380852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.381127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.396588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:56.401496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:56.402813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:56.403541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 73/142] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:00:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:56.410359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403d575-c50c-43c6-afee-d9172354ec75 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:56.475401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:56.614880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403d575-c50c-43c6-afee-d9172354ec75 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:56.669159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71520-bd57-4314-8b6b-509397259539 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:56.677566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:56.678198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.678505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.678779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.679470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:56.679774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:56.681180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:56.690069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 70/143] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:56.697434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:56.737432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:56.738723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.739893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.740557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.742005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:56.743879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:56.746445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 74/144] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:56.752157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:56.778512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:56.808876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:56.865878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb940a27-a4fe-4e3d-80d8-a2b97a28a4fa None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:56.912342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:56.912996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:56.913276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:56.913551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] PATH_INFO: `/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:56.914925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] RBAC: Authorizing `identity:get_user(user_id=8d1271b1c1034e5fb48b3fb098c1b6b3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:56.916403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:56.918342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 71/145] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:56 2022] GET /identity/v3/users/8d1271b1c1034e5fb48b3fb098c1b6b3 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:56.924381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:56.959677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cde95a-5bb9-44b8-bd34-56f03c9a831c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:57.027250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:57.028433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:57.028987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:57.029462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:57.030380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:57.032235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:57.062880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a73b58-9cec-4dde-a966-7f114b3baa2d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:57.075138 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:57.090783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 75/146] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:00:56 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:00:57.118828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:57.119357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:57.119643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:57.119920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:57.233244 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:57.234856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:57.423338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 72/147] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:00:57.429791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:57.538500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:57.562901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152274e-46e4-40e2-a08f-92d22396f9a3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:57.623876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb14ded-ec1e-4456-8484-3db4e11d8137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:57.624531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb14ded-ec1e-4456-8484-3db4e11d8137 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:57.624810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb14ded-ec1e-4456-8484-3db4e11d8137 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:57.625078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb14ded-ec1e-4456-8484-3db4e11d8137 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:57.626648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb14ded-ec1e-4456-8484-3db4e11d8137 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:57.628106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb14ded-ec1e-4456-8484-3db4e11d8137 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:57.630724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 76/148] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:57 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:57.637313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:57.646806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:57.735902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973428-e459-425f-86e5-7ca31bf0858f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:57.736439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973428-e459-425f-86e5-7ca31bf0858f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:57.736648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2973428-e459-425f-86e5-7ca31bf0858f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:57.738450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 77/149] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:57.754106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32f9e-701b-4a12-9ebe-8eeb8568a914 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:57.754865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32f9e-701b-4a12-9ebe-8eeb8568a914 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:57.756121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f32f9e-701b-4a12-9ebe-8eeb8568a914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:57.788162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-68f32f9e-701b-4a12-9ebe-8eeb8568a914 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:57.789906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-68f32f9e-701b-4a12-9ebe-8eeb8568a914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:57.826437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d1a8b-cb02-403f-a1a9-448d2776b400 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:57.905640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e9297-c62e-477f-abcd-f925e741c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:57.906281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e9297-c62e-477f-abcd-f925e741c0af None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:57.906568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e9297-c62e-477f-abcd-f925e741c0af None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:57.906839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e9297-c62e-477f-abcd-f925e741c0af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:57.907599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e9297-c62e-477f-abcd-f925e741c0af None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=8d1271b1c1034e5fb48b3fb098c1b6b3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:57.907905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e9297-c62e-477f-abcd-f925e741c0af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:57.913362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e9297-c62e-477f-abcd-f925e741c0af None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:57.921081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 78/150] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:57.926319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 73/151] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:00:57 2022] GET /identity/v3/role_assignments?user.id=8d1271b1c1034e5fb48b3fb098c1b6b3&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:58.343703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b98271-c39c-46a5-be2f-21033e02a993 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:58.344084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b98271-c39c-46a5-be2f-21033e02a993 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:58.344236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b98271-c39c-46a5-be2f-21033e02a993 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:58.345883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 79/152] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:58.355885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da36fb0-0e2e-4ab8-aae4-4c07e1c308b9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:58.355885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da36fb0-0e2e-4ab8-aae4-4c07e1c308b9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:58.355885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da36fb0-0e2e-4ab8-aae4-4c07e1c308b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:58.371464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b98271-c39c-46a5-be2f-21033e02a993 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:58.380892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3da36fb0-0e2e-4ab8-aae4-4c07e1c308b9 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:58.382858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3da36fb0-0e2e-4ab8-aae4-4c07e1c308b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:58.475058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:58.483095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 74/153] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:00:58.582446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:58.644477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b98271-c39c-46a5-be2f-21033e02a993 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:58.699469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:58.700187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:58.700469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:58.700791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:58.717282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:58.725226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:58.726321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:00:58.727071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:00:58.727657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 80/154] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:00:58.735618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da36fb0-0e2e-4ab8-aae4-4c07e1c308b9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:58.899965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da36fb0-0e2e-4ab8-aae4-4c07e1c308b9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:58.946748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:58.947759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:58.948431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:58.948943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:58.949918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:58.950443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:58.952055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:58.963084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 75/155] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:00:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:58.968685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:59.018136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:59.132510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3f1fd-3e3f-46b6-92d0-d33e5b2adc34 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:59.160939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:59.185365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:59.186025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.186328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.186622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] PATH_INFO: `/v3/users/6d7ab6ad36b0433795e468aebc4dbbc9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.193727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] RBAC: Authorizing `identity:get_user(user_id=6d7ab6ad36b0433795e468aebc4dbbc9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:59.195326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:59.197320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 81/156] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:58 2022] GET /identity/v3/users/6d7ab6ad36b0433795e468aebc4dbbc9 => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:59.207568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:59.220853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:59.248452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37437f41-ed87-4bb4-9e15-87fe9647ec0f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:59.338361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e40d-07d4-4765-854f-97f15e62770b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:59.356424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1442ae-e3d9-40d8-ac67-0e30658a5985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:59.357513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1442ae-e3d9-40d8-ac67-0e30658a5985 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.357813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1442ae-e3d9-40d8-ac67-0e30658a5985 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.358097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1442ae-e3d9-40d8-ac67-0e30658a5985 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.384215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1442ae-e3d9-40d8-ac67-0e30658a5985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:00:59.385342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:59.385995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.386289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.386567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.391774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:59.393246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3e1442ae-e3d9-40d8-ac67-0e30658a5985 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:00:59.396843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:00:59.397811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:00:59.398633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 76/157] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:00:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:00:59.399659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838856-9802-4a20-a8ac-b5bec654ea32 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.399781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838856-9802-4a20-a8ac-b5bec654ea32 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.401529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04838856-9802-4a20-a8ac-b5bec654ea32 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.401529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 77/158] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:59.401809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 82/159] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:00:59 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:59.411912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:59.413899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1ae6-c373-4496-9e36-b1f68ed7586d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.417593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1ae6-c373-4496-9e36-b1f68ed7586d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.418134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1ae6-c373-4496-9e36-b1f68ed7586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.452949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-81aa1ae6-c373-4496-9e36-b1f68ed7586d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:59.454185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-81aa1ae6-c373-4496-9e36-b1f68ed7586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:00:59.566608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:59.608873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 78/160] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:00:59.609757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa1ae6-c373-4496-9e36-b1f68ed7586d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:59.609978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f01d90-3fae-4963-b015-fdec0e875825 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:59.683668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:59.685109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.685543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.686342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.687419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:00:59.687908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:59.689459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:59.710266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 83/161] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:00:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:00:59.714632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:59.718688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:59.810180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa1ae6-c373-4496-9e36-b1f68ed7586d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:59.855913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe050c-61b3-436e-88c7-7bfef20f12a3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:00:59.869060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:59.869752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.870030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.870527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/6d7ab6ad36b0433795e468aebc4dbbc9/roles/a90fc9cb49094b28b26944892f24382b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.875091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc875dd0aa549dca8f19d0ce581bb84, user_id=6d7ab6ad36b0433795e468aebc4dbbc9, role_id=a90fc9cb49094b28b26944892f24382b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:59.876830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:59.895991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcad41-a270-4bd7-a27d-0b5e5613348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:00:59.896427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcad41-a270-4bd7-a27d-0b5e5613348a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.896996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcad41-a270-4bd7-a27d-0b5e5613348a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.897606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcad41-a270-4bd7-a27d-0b5e5613348a None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.899029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcad41-a270-4bd7-a27d-0b5e5613348a None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:00:59.901127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcad41-a270-4bd7-a27d-0b5e5613348a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:00:59.902970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 84/162] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:00:59 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:00:59.904453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807d35-2315-4d88-a358-97759d3f81f9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.904737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807d35-2315-4d88-a358-97759d3f81f9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.905090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80807d35-2315-4d88-a358-97759d3f81f9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.906608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 85/163] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:00:59.909071 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 79/164] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:00:59 2022] PUT /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/users/6d7ab6ad36b0433795e468aebc4dbbc9/roles/a90fc9cb49094b28b26944892f24382b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:00:59.915437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad648598-f78f-4d51-a5f4-84b0d2a5ca28 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:00:59.915956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad648598-f78f-4d51-a5f4-84b0d2a5ca28 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:00:59.916369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad648598-f78f-4d51-a5f4-84b0d2a5ca28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:00:59.919792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:00:59.938737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ad648598-f78f-4d51-a5f4-84b0d2a5ca28 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:00:59.940355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:00:59.940866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ad648598-f78f-4d51-a5f4-84b0d2a5ca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:00.025206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 86/165] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:00:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:00.128204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c90a-72c6-4b17-a579-c0af8c273fd5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:00.150845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:00.179464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:00.180428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:00.180913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:00.181361 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:00.258882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:00.260663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:00.272574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad648598-f78f-4d51-a5f4-84b0d2a5ca28 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:00.399579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 80/166] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:01:00.409158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:00.440077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:00.460997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad648598-f78f-4d51-a5f4-84b0d2a5ca28 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:00.567205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:00.568371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:00.568665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:00.568944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:00.575340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:00.590875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:00.602267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:00.603714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:00.604634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:00.607253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 87/167] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:00.615581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:00.666549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131f7c4-c335-46b2-8317-92088ec043c8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:00.788351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:00.789010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:00.789300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:00.789574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:00.794973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:00.796463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:00.798233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 81/168] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:00 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:00.804526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:00.921842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa57c88-13ba-4a19-b335-9a4a4876877b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:01.122220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:01.122220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.122220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.122220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.122669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:01.122669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:01.125537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:01.134758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:01.169981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 88/169] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 555 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:01.172226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:01.212969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf97a1-8d71-4f0c-87ab-d68aa25962f8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:01.318801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:01.319475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.319764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.320043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.342539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:01.351831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:01.353843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 82/170] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 554 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:01.355648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:01.496882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:01.667000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e3c8cf-7b37-4be7-917f-799bb17b1a85 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:01.718356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0590aa7-d966-4a20-8e48-e7ae9c4874f1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:01.772414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:01.773082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.773368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.773643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.776973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:01.778568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:01.785175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 83/171] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:01 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:01.786935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:01.809029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:01.849391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:01.850475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:01.850977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:01.851600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:01.852934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=77862a319a1646ef8dc2149d2122db07) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:01.853477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:01.856509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:01.873685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 89/172] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:01 2022] GET /identity/v3/role_assignments?user.id=77862a319a1646ef8dc2149d2122db07&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=2d6361445523491fb757e0b12f225dcb => generated 608 bytes in 703 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:01.883326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.051922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0ec31-6ba5-45b5-9f9a-330d63042051 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.075288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52a5e-6d5f-48cf-a10e-88e88976ea4c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.111564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.132590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a23714-b677-41c5-903b-f04bfaa9e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.133239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a23714-b677-41c5-903b-f04bfaa9e921 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.133519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a23714-b677-41c5-903b-f04bfaa9e921 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.133792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a23714-b677-41c5-903b-f04bfaa9e921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.142340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.143174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.143307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.143563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.144211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:02.144552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.146854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.178079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 84/173] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:02.184019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.325310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a23714-b677-41c5-903b-f04bfaa9e921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.326787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a23714-b677-41c5-903b-f04bfaa9e921 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.362629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.429627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa681849-105d-4ca3-9db3-a63507730d76 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.505056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b98d66-b2f0-4d41-9a4b-895109973bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.506033 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98d66-b2f0-4d41-9a4b-895109973bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.506397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98d66-b2f0-4d41-9a4b-895109973bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.506677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98d66-b2f0-4d41-9a4b-895109973bb6 None admin] PATH_INFO: `/v3/users/77862a319a1646ef8dc2149d2122db07` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.507942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b98d66-b2f0-4d41-9a4b-895109973bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=77862a319a1646ef8dc2149d2122db07)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.509432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b98d66-b2f0-4d41-9a4b-895109973bb6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.511146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 85/174] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/users/77862a319a1646ef8dc2149d2122db07 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:02.519782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f4e7-ec4c-41f1-a776-e97f148a19e2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.520236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f4e7-ec4c-41f1-a776-e97f148a19e2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.520981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988f4e7-ec4c-41f1-a776-e97f148a19e2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.522964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 86/175] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:02.523534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f4e7-ec4c-41f1-a776-e97f148a19e2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.528626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 90/176] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:02.535868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ad2e-5ba1-4691-83be-cdb75b93e3ee None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.536275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ad2e-5ba1-4691-83be-cdb75b93e3ee None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.536425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63ad2e-5ba1-4691-83be-cdb75b93e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.560882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0a63ad2e-5ba1-4691-83be-cdb75b93e3ee None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:02.562136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0a63ad2e-5ba1-4691-83be-cdb75b93e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:02.584977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.657988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 91/177] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:02.659241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ad2e-5ba1-4691-83be-cdb75b93e3ee None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.683343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988f4e7-ec4c-41f1-a776-e97f148a19e2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.725494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ab769-cada-4960-ad9a-939573f6313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.726126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ab769-cada-4960-ad9a-939573f6313e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.726431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ab769-cada-4960-ad9a-939573f6313e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.726706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ab769-cada-4960-ad9a-939573f6313e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.744354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.819304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ab769-cada-4960-ad9a-939573f6313e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.819676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63ad2e-5ba1-4691-83be-cdb75b93e3ee None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:02.820816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ab769-cada-4960-ad9a-939573f6313e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.867609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454de52-cc95-46c8-9f0d-487ebe7a0c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:02.868185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454de52-cc95-46c8-9f0d-487ebe7a0c13 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.868471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454de52-cc95-46c8-9f0d-487ebe7a0c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.868929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454de52-cc95-46c8-9f0d-487ebe7a0c13 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.871043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454de52-cc95-46c8-9f0d-487ebe7a0c13 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:02.872532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454de52-cc95-46c8-9f0d-487ebe7a0c13 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:02.874420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 92/178] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:02.879741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9a87-ab8d-428b-84bb-69ef5cf3da0d None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.880125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9a87-ab8d-428b-84bb-69ef5cf3da0d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.885291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9a87-ab8d-428b-84bb-69ef5cf3da0d None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.885291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 93/179] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:02.885291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490f843-7ae4-4bb5-820f-f1a6f5a4d673 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.885291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490f843-7ae4-4bb5-820f-f1a6f5a4d673 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.885291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490f843-7ae4-4bb5-820f-f1a6f5a4d673 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:02.885291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 94/180] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:02.885291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490f843-7ae4-4bb5-820f-f1a6f5a4d673 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:02.920469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:02.980526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 87/181] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:02.982191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334cd4-a770-4e35-8a14-5bdf2e7cde72 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:02.982640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334cd4-a770-4e35-8a14-5bdf2e7cde72 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:02.982968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334cd4-a770-4e35-8a14-5bdf2e7cde72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.013387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-37334cd4-a770-4e35-8a14-5bdf2e7cde72 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:03.015403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-37334cd4-a770-4e35-8a14-5bdf2e7cde72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:03.029081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490f843-7ae4-4bb5-820f-f1a6f5a4d673 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.070860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.073690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c7e5a-7208-459f-bc77-2277c6af3bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.074348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c7e5a-7208-459f-bc77-2277c6af3bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.074768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c7e5a-7208-459f-bc77-2277c6af3bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.075053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c7e5a-7208-459f-bc77-2277c6af3bc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.076117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c7e5a-7208-459f-bc77-2277c6af3bc1 None admin] RBAC: Adding query filter params (role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=77862a319a1646ef8dc2149d2122db07) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:03.076435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c7e5a-7208-459f-bc77-2277c6af3bc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.077923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c7e5a-7208-459f-bc77-2277c6af3bc1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.092561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 95/182] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:02 2022] GET /identity/v3/role_assignments?user.id=77862a319a1646ef8dc2149d2122db07&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:03.094110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ffeee-3067-44a6-88af-ff321c0a5486 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.094429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ffeee-3067-44a6-88af-ff321c0a5486 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.094710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ffeee-3067-44a6-88af-ff321c0a5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.150945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3f3ffeee-3067-44a6-88af-ff321c0a5486 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:03.153213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3f3ffeee-3067-44a6-88af-ff321c0a5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:03.164477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 88/183] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:03.165488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37334cd4-a770-4e35-8a14-5bdf2e7cde72 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.306308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 96/184] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:03.307900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ffeee-3067-44a6-88af-ff321c0a5486 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.318659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37334cd4-a770-4e35-8a14-5bdf2e7cde72 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.331702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.373094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1dc27-d795-4ee0-bd11-9184a91cec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.374126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1dc27-d795-4ee0-bd11-9184a91cec20 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.374670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1dc27-d795-4ee0-bd11-9184a91cec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.375171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1dc27-d795-4ee0-bd11-9184a91cec20 None admin] PATH_INFO: `/v3/projects/87bb387986a948ccbdfaf520340fd21a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.376629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1dc27-d795-4ee0-bd11-9184a91cec20 None admin] RBAC: Authorizing `identity:get_project(project_id=87bb387986a948ccbdfaf520340fd21a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.378464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1dc27-d795-4ee0-bd11-9184a91cec20 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.382041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 89/185] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/projects/87bb387986a948ccbdfaf520340fd21a => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:03.384558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea092-4d1c-4ce7-b129-d32b21279ecc None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.385127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea092-4d1c-4ce7-b129-d32b21279ecc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.385682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ea092-4d1c-4ce7-b129-d32b21279ecc None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.387316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 90/186] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:03.393834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93e18-61e2-4939-9fb0-584b4ab3a5f1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.394490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93e18-61e2-4939-9fb0-584b4ab3a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.395044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93e18-61e2-4939-9fb0-584b4ab3a5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.420208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-30a93e18-61e2-4939-9fb0-584b4ab3a5f1 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:03.421932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-30a93e18-61e2-4939-9fb0-584b4ab3a5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:03.464967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.500104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ffeee-3067-44a6-88af-ff321c0a5486 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.534273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 91/187] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:03.534273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a93e18-61e2-4939-9fb0-584b4ab3a5f1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.585703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.590392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.590392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.590392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.625527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:03.639236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:03.640917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:03.642996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 97/188] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:03.644219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.681102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a93e18-61e2-4939-9fb0-584b4ab3a5f1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.723965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.724770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.725222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.725373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.726272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=87bb387986a948ccbdfaf520340fd21a, user.id=77862a319a1646ef8dc2149d2122db07) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:03.726619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.728161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.746299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 92/189] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/role_assignments?user.id=77862a319a1646ef8dc2149d2122db07&scope.project.id=87bb387986a948ccbdfaf520340fd21a&role.id=2d6361445523491fb757e0b12f225dcb => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:03.746299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:03.797387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.802859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:03.846291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df9a06-7bcc-4a89-be52-dad189182455 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.920995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:03.922418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:03.923504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:03.924077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:03.927216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:03.928737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11466430-8d86-435b-a154-b18d876b6b1a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:03.929798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:03.934429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 98/190] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:03.936034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.012697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.014151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.014684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.015157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.038347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:04.045203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:04.046986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:04.048378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:04.051129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 93/191] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:04.051129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.129120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c942391-4d7e-4a8f-bc59-b5b72f21f954 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.180296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.181607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.182055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.182534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.183636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:04.184125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.186312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.188724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.201346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 99/192] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.202459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.207204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.210821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0666e19-31dc-4e2e-bf62-0c2f5e592e2f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.258471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.259412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.259770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.260106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.260807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.262557 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.287180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 94/193] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:04 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:04.288419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.381271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0162b-dd02-471a-951c-2c8e73e1dde6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.430754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.431421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.431695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.431957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.446678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:04.452202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:04.453932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 100/194] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:04.455524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.471380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef65c65-0a92-4774-9ef6-d4f22962d16f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.530979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.531970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.532517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.532965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.534880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:04.534880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.537731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.554425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 95/195] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.554425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.572640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.585797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.678593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef681b5-2f34-4722-ad90-3c95dae887c7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.719013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32539c6-19bc-46e9-add9-a431f9c63d7c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:04.738988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.740020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.740474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.740925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] PATH_INFO: `/v3/users/3866d852093c47798c7972ac91d8ae22` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.764778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] RBAC: Authorizing `identity:get_user(user_id=3866d852093c47798c7972ac91d8ae22)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.767875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.771040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 101/196] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/users/3866d852093c47798c7972ac91d8ae22 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.772441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.780068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:04.781358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:04.782001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:04.782435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:04.783258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:04.783718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:04.785338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:04.798215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 96/197] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:04.799234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:04.946775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:04.965405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ace88-8cc8-471b-ba4b-380975acb9f7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.009632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44562ba6-a256-4763-8475-1f4bc343b79b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.014620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.039296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.039565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.039988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.040433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] PATH_INFO: `/v3/users/3866d852093c47798c7972ac91d8ae22` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.042534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] RBAC: Authorizing `identity:get_user(user_id=3866d852093c47798c7972ac91d8ae22)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.045141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.048448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 102/198] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/users/3866d852093c47798c7972ac91d8ae22 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:05.049905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.080225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.081251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.081692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.082127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.212939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.215726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.234454 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0641-bf4b-4be7-a5f7-1eb96d6a1ead None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.298205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.299148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.299599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.300042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] PATH_INFO: `/v3/users/6d7ab6ad36b0433795e468aebc4dbbc9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.302268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] RBAC: Authorizing `identity:get_user(user_id=6d7ab6ad36b0433795e468aebc4dbbc9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.304854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.308340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 103/199] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/users/6d7ab6ad36b0433795e468aebc4dbbc9 => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:05.309690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.344125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.410140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 97/200] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:05.412731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:05.447423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.539131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00eae37-acbd-4ffe-bbe9-a602a90cfeba None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.616344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.617507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81529ef4-f6ad-4091-89a6-4a67525ed5a7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:05.617875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.618549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.619165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.682141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:05.683247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:05.683804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:05.684255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:05.758089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.785278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.788322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.814603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:05.817445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:05.902595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:05.998204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 104/201] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:06.001194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.031438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 98/202] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:06.032814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.163454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:06.204229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79d838-805f-4c6f-bb8b-5f04f53802ff None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.220685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124491a-a159-426e-bb21-dd62cff214c6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.278699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.279444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.279729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.280002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.281257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:06.282754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:06.284759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 105/203] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:05 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:06.285431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.290730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.291868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.292369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.292986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.297654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:06.300242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:06.308028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 99/204] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:06.308028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.324093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:06.456454 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731dbce-d33f-4c82-ae12-89cb38d81e16 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.509256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2bf41-4856-43db-8099-8f60e92ed97e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.525856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.526913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.527359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.527798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.530152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:06.533569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:06.538783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 106/205] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:06.540722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.580776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.581739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.582184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.582687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.584183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=3866d852093c47798c7972ac91d8ae22) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:06.584690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:06.594532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:06.605691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 100/206] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/role_assignments?user.id=3866d852093c47798c7972ac91d8ae22&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:06.607091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:06.612012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:06.753166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:06.767759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341893ac-674d-4e29-bd22-53a0926f651f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.787318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbab96e-84ef-4a3f-aa83-9af0b5d68574 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:06.825413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25ef2b-5190-4db3-a630-b1df6dfd391d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.826471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25ef2b-5190-4db3-a630-b1df6dfd391d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.826891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25ef2b-5190-4db3-a630-b1df6dfd391d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.827319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25ef2b-5190-4db3-a630-b1df6dfd391d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.828206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25ef2b-5190-4db3-a630-b1df6dfd391d None admin] RBAC: Adding query filter params (role.id=a90fc9cb49094b28b26944892f24382b, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84, user.id=6d7ab6ad36b0433795e468aebc4dbbc9) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:06.828672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25ef2b-5190-4db3-a630-b1df6dfd391d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:06.830602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25ef2b-5190-4db3-a630-b1df6dfd391d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:06.834888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:06.835915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.836378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.836844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.838207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] RBAC: Adding query filter params (role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=3866d852093c47798c7972ac91d8ae22) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:06.838769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:06.839693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 101/207] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/role_assignments?user.id=6d7ab6ad36b0433795e468aebc4dbbc9&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=a90fc9cb49094b28b26944892f24382b => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:06.841356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd0adf-b8e6-4e54-a43e-12714a08e47e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.841688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:06.842029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd0adf-b8e6-4e54-a43e-12714a08e47e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.842511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd0adf-b8e6-4e54-a43e-12714a08e47e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.844315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 102/208] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:06.853030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc51df8-78d7-4781-a194-be671beb5174 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:06.853030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc51df8-78d7-4781-a194-be671beb5174 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:06.853030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc51df8-78d7-4781-a194-be671beb5174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:06.853355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 107/209] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:06 2022] GET /identity/v3/role_assignments?user.id=3866d852093c47798c7972ac91d8ae22&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:06.873377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-abc51df8-78d7-4781-a194-be671beb5174 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:06.874755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-abc51df8-78d7-4781-a194-be671beb5174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:07.009937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:07.030804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 103/210] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:07.350584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:07.555107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd189b-f596-4f16-acb9-153021a60b5d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:07.601155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58d700-f822-4642-a637-578840a0f494 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.602550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58d700-f822-4642-a637-578840a0f494 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.603304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58d700-f822-4642-a637-578840a0f494 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.605953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 104/211] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:07.612203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6041042-6281-4712-8e75-c9e597ef8dd5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.612795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6041042-6281-4712-8e75-c9e597ef8dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.613288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6041042-6281-4712-8e75-c9e597ef8dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.624286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:07.624286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.624549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.624815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.640861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:07.650851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:07.651748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:07.652508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:07.653663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b6041042-6281-4712-8e75-c9e597ef8dd5 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:07.653745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 108/212] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:07.653819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b6041042-6281-4712-8e75-c9e597ef8dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:07.659565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:07.703227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:07.788035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 105/213] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:07.842932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d405bf-19a0-4034-abde-f859aec1c022 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:07.907493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:07.908508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:07.908989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:07.909472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:07.911324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:07.911891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:07.914557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:07.931725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 109/214] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:07.936986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6041042-6281-4712-8e75-c9e597ef8dd5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:08.048802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6041042-6281-4712-8e75-c9e597ef8dd5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:08.080708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:08.093642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:08.094353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.094619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.094897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] PATH_INFO: `/v3/users/d57eed1bf0894fdfa71407906a7f1338` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.104116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:08.120588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] RBAC: Authorizing `identity:get_user(user_id=d57eed1bf0894fdfa71407906a7f1338)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:08.124192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:08.128531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 106/215] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:07 2022] GET /identity/v3/users/d57eed1bf0894fdfa71407906a7f1338 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:08.134509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:08.213929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:08.239934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073a539-6603-43c8-9543-8f2bfdddfc66 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:08.301057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b59b5b-315b-4705-ad7d-8bcafaabbaef None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:08.312667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:08.313898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.314506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.315097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.317777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:08.320737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:08.324022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 110/216] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:08.334518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:08.364123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:08.365268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.365760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.366314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.474382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:08.506531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:08.509859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:08.530216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e569c-c508-4b61-b36b-5fe0814e852b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:08.594285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:08.596049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:08.596788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:08.597472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:08.600370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:08.603179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:08.641300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 111/217] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:08 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:01:08.747887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 107/218] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:08.759420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:08.767044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:08.976203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f8e83-cb36-4ece-ba5f-51ffe9dd3769 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:09.051697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e4835-0145-43dc-9fb2-9509316c88b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:09.052800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4835-0145-43dc-9fb2-9509316c88b4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.053254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4835-0145-43dc-9fb2-9509316c88b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.053690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e4835-0145-43dc-9fb2-9509316c88b4 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.055775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e4835-0145-43dc-9fb2-9509316c88b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:09.058577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e4835-0145-43dc-9fb2-9509316c88b4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:09.061958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 112/219] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:08 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:09.072386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:09.236668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:09.259831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d259813-ad1f-4a84-bd88-a864ddb1508e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:09.302800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e651-85ec-4f29-a0e2-4b578da12c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:09.303763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e651-85ec-4f29-a0e2-4b578da12c27 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.304263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e651-85ec-4f29-a0e2-4b578da12c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.304738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e651-85ec-4f29-a0e2-4b578da12c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.305713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81e651-85ec-4f29-a0e2-4b578da12c27 None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=d57eed1bf0894fdfa71407906a7f1338) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:09.306322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81e651-85ec-4f29-a0e2-4b578da12c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:09.308053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81e651-85ec-4f29-a0e2-4b578da12c27 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:09.315091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 108/220] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:09 2022] GET /identity/v3/role_assignments?user.id=d57eed1bf0894fdfa71407906a7f1338&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=2d6361445523491fb757e0b12f225dcb => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:09.392307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d4085-6eb9-4b2b-b3d2-ff5fbdad7d22 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.393004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d4085-6eb9-4b2b-b3d2-ff5fbdad7d22 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.393488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d4085-6eb9-4b2b-b3d2-ff5fbdad7d22 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.395384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 113/221] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:09.401930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2787b-63b2-44ca-bb6d-88e33d0c7ae3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.402582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2787b-63b2-44ca-bb6d-88e33d0c7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.403090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2787b-63b2-44ca-bb6d-88e33d0c7ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.431507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-20c2787b-63b2-44ca-bb6d-88e33d0c7ae3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:09.433101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-20c2787b-63b2-44ca-bb6d-88e33d0c7ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:09.542737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 109/222] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:09.857225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266f13-0f06-4f55-bd6c-82e94df57bc0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.858172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266f13-0f06-4f55-bd6c-82e94df57bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.858657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05266f13-0f06-4f55-bd6c-82e94df57bc0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.860268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 114/223] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:09.869527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46c6b-8998-4e77-9d08-b787c55252e8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:09.870489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46c6b-8998-4e77-9d08-b787c55252e8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:09.870941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46c6b-8998-4e77-9d08-b787c55252e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:09.899475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-37b46c6b-8998-4e77-9d08-b787c55252e8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:09.901063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-37b46c6b-8998-4e77-9d08-b787c55252e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:10.002127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 110/224] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:10.054998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05266f13-0f06-4f55-bd6c-82e94df57bc0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.218990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.289049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05266f13-0f06-4f55-bd6c-82e94df57bc0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.345442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b46c6b-8998-4e77-9d08-b787c55252e8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.365645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.366755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.367230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.367706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.368437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.387968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:10.398487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:10.400253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:10.401896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 115/225] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:10.410224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.586971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b46c6b-8998-4e77-9d08-b787c55252e8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.630778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a244220-cfb5-4a54-b7e0-b4495a0a47c5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.692887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:10.698966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.700630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.701105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.701589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.703087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:10.703633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:10.706356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:10.730553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 116/226] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:10.734575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.751727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:10.752400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:10.752822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:10.752987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:10.807001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:10.812041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:10.813772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:10.815380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 111/227] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:10.823377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:10.966025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71751-292a-4977-b82f-df225eb15c09 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:10.986097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.046761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.047417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.047692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.047965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] PATH_INFO: `/v3/users/3866d852093c47798c7972ac91d8ae22` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.052693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] RBAC: Authorizing `identity:get_user(user_id=3866d852093c47798c7972ac91d8ae22)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.054090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.058824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a5eab-2d9b-4216-bfa9-8fc7a9f4907b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.061786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 117/228] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/users/3866d852093c47798c7972ac91d8ae22 => generated 283 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:11.070978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.147227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.147860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.148140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.148418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.149102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:11.149400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.150866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.172564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 112/229] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:11.180155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.233266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.341754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ebd5f-b07f-4f1b-9f92-18f57cb86eb4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.402923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9c980-50ba-49bb-9733-656aeefe1a8f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.420857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.422210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.422909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.423539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.425800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.432768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.436050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 118/230] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:11.445970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.467542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.483221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.486347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.487105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.488105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] PATH_INFO: `/v3/users/3866d852093c47798c7972ac91d8ae22` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.491327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] RBAC: Authorizing `identity:get_user(user_id=3866d852093c47798c7972ac91d8ae22)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.494727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.496998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 113/231] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/users/3866d852093c47798c7972ac91d8ae22 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:11.503008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.712236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693b06c-1972-4762-8087-9a2cec3a43af None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.714668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2d37-827b-4f70-b32f-d1e3051f394a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:11.784660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:11.798713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe06f6-c3cc-4cdf-b90b-20d3cfe84298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.800204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe06f6-c3cc-4cdf-b90b-20d3cfe84298 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.801656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe06f6-c3cc-4cdf-b90b-20d3cfe84298 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.803151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe06f6-c3cc-4cdf-b90b-20d3cfe84298 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b/users/3866d852093c47798c7972ac91d8ae22/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.807545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe06f6-c3cc-4cdf-b90b-20d3cfe84298 None admin] RBAC: Authorizing `identity:create_grant(project_id=e247570ef496410fa5831306e0872f1b, user_id=3866d852093c47798c7972ac91d8ae22, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.808558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:11.809487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:11.811409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe06f6-c3cc-4cdf-b90b-20d3cfe84298 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.812076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:11.812554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:11.816217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:11.819092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:11.821991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 114/232] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:11 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:11.830489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:11.848370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 119/233] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:11 2022] PUT /identity/v3/projects/e247570ef496410fa5831306e0872f1b/users/3866d852093c47798c7972ac91d8ae22/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:11.994651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:12.076689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617495e-9983-4cc6-bb9e-0ebbba50f577 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:12.119144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ad8ab-70c5-4a18-9838-b81462d6d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:12.120295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ad8ab-70c5-4a18-9838-b81462d6d218 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.120784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ad8ab-70c5-4a18-9838-b81462d6d218 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.121260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ad8ab-70c5-4a18-9838-b81462d6d218 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b/users/3866d852093c47798c7972ac91d8ae22/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.123933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ad8ab-70c5-4a18-9838-b81462d6d218 None admin] RBAC: Authorizing `identity:create_grant(project_id=e247570ef496410fa5831306e0872f1b, user_id=3866d852093c47798c7972ac91d8ae22, role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:12.125662 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ad8ab-70c5-4a18-9838-b81462d6d218 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:12.148577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 115/234] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:11 2022] PUT /identity/v3/projects/e247570ef496410fa5831306e0872f1b/users/3866d852093c47798c7972ac91d8ae22/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:12.512820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8c37-cf92-47ff-ab9c-edb5fed613d9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.513905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8c37-cf92-47ff-ab9c-edb5fed613d9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.514483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c8c37-cf92-47ff-ab9c-edb5fed613d9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.516643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 120/235] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:12.527018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d068f-ecc2-4aef-ac7c-7b249de07b22 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.528715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d1194-142a-4ee3-a002-03a469bef3c8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.529244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d1194-142a-4ee3-a002-03a469bef3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.529757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d1194-142a-4ee3-a002-03a469bef3c8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.530151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d068f-ecc2-4aef-ac7c-7b249de07b22 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.530671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d068f-ecc2-4aef-ac7c-7b249de07b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.531892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 121/236] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:12.540793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f5bd-862d-4c05-be9a-b2abc288fd76 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.541438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f5bd-862d-4c05-be9a-b2abc288fd76 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.541945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866f5bd-862d-4c05-be9a-b2abc288fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.573147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a89d068f-ecc2-4aef-ac7c-7b249de07b22 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:12.574462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a89d068f-ecc2-4aef-ac7c-7b249de07b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:12.580531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c866f5bd-862d-4c05-be9a-b2abc288fd76 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:12.582630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c866f5bd-862d-4c05-be9a-b2abc288fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:12.681858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 116/237] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:12.683627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787fe8b-01ba-4725-801f-e97e882810ac None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.683922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787fe8b-01ba-4725-801f-e97e882810ac None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.684201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787fe8b-01ba-4725-801f-e97e882810ac None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.685996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 117/238] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:12.692225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7faa3c-8919-4700-a36e-648068458e57 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:12.692892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7faa3c-8919-4700-a36e-648068458e57 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:12.693322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7faa3c-8919-4700-a36e-648068458e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:12.714480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3a7faa3c-8919-4700-a36e-648068458e57 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:12.715968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3a7faa3c-8919-4700-a36e-648068458e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:12.721947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 122/239] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:12.785150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:12.798935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 118/240] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:13.189707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866f5bd-862d-4c05-be9a-b2abc288fd76 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.233001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7faa3c-8919-4700-a36e-648068458e57 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.363087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866f5bd-862d-4c05-be9a-b2abc288fd76 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.387973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:13.406603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7faa3c-8919-4700-a36e-648068458e57 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.407562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.408644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.409088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.409429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.424763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:13.430878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:13.431850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:13.432612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 123/241] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:13.433892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.452496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.453691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.453978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.454576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.472868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:13.480810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:13.481792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:13.482587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 119/242] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:13.483225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.559568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:13.567353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefb764-7c66-454a-8b21-14593f3fad42 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.613542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.615039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.615573 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.616029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.617541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:13.619421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:13.621388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 124/243] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:13.626891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.641968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372f19-e418-4d9e-beac-a36deebbd2e4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.682899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.683625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.683975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.684322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.685375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:13.685375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:13.686932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:13.688579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:13.697743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 120/244] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:13.698830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.759970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5de0-b5c5-4b41-b2e3-ff983fe8b123 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.823379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fb0ec-2cb4-4248-889d-904cbf098322 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:13.834838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:13.838434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.840024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.840664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.841282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.842549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:13.843304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:13.846231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:13.866658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:13.867284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:13.867555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:13.867828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:13.868659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:13.869205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 125/245] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:13.870115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:13.871444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:13.902280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 121/246] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:13 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:13.902280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.057247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac7f0b-fd4c-4d3c-9a61-f5b25ef434ab None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.131179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.131849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.132122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.132402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] PATH_INFO: `/v3/users/5e8b4acc54dc438ba2732633c8332706` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.168757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8b4acc54dc438ba2732633c8332706)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.171091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.177950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 122/247] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/users/5e8b4acc54dc438ba2732633c8332706 => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:14.184661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2601dde-6b43-4280-868a-07c9283fcb97 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.184905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.200044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:14.226683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:14.245600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.246301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.246586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.246861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] PATH_INFO: `/v3/users/d57eed1bf0894fdfa71407906a7f1338` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.248153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] RBAC: Authorizing `identity:get_user(user_id=d57eed1bf0894fdfa71407906a7f1338)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.249642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.252112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 126/248] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:13 2022] GET /identity/v3/users/d57eed1bf0894fdfa71407906a7f1338 => generated 297 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:14.258855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.338353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319d9aa-ad21-4416-8c75-d34051e144c5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.386692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.387319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.387604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.387879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.417611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605a5d2-f787-43b6-9275-3153bfe6547e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.473129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.474369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.474840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.475321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.476877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.479522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.482764 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 127/249] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:14 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:14.491138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.497357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.499202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.529544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:14.592035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:14.693979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 123/250] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:14.699954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.706262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349ab90-3ad2-43bb-acf9-0abdceff2e1a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.776740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.777866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.778393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.778874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b/users/d57eed1bf0894fdfa71407906a7f1338/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.782426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e247570ef496410fa5831306e0872f1b, user_id=d57eed1bf0894fdfa71407906a7f1338, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.785610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.820413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 128/251] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:14 2022] PUT /identity/v3/projects/e247570ef496410fa5831306e0872f1b/users/d57eed1bf0894fdfa71407906a7f1338/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:14.875497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff883ddb-b994-4cac-865a-626d1f5b6aec None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:14.906089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:14.928140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da881f-72b8-4049-b96d-b6fb8be1f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:14.928820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da881f-72b8-4049-b96d-b6fb8be1f975 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.929101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da881f-72b8-4049-b96d-b6fb8be1f975 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.929375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da881f-72b8-4049-b96d-b6fb8be1f975 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.930704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da881f-72b8-4049-b96d-b6fb8be1f975 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:14.932259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da881f-72b8-4049-b96d-b6fb8be1f975 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:14.934409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 124/252] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:14 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:14.941209 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:14.960032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827cbd-e9c7-433b-98e7-5acae1b6fe0e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.960369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827cbd-e9c7-433b-98e7-5acae1b6fe0e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.960593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827cbd-e9c7-433b-98e7-5acae1b6fe0e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:14.962200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 125/253] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:14.971723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f4ce-6a3a-4b02-b77f-221ac616fd69 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:14.972038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f4ce-6a3a-4b02-b77f-221ac616fd69 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:14.972275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571f4ce-6a3a-4b02-b77f-221ac616fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.000520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a571f4ce-6a3a-4b02-b77f-221ac616fd69 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:15.001849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a571f4ce-6a3a-4b02-b77f-221ac616fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:15.093329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 126/254] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:15.182489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38b1c0-fb2e-4a13-9c24-021760f1c1e6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:15.197719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:15.251249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450077be-d3f1-466e-8de0-7666f8f77fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:15.252230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450077be-d3f1-466e-8de0-7666f8f77fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:15.252696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450077be-d3f1-466e-8de0-7666f8f77fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:15.253163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450077be-d3f1-466e-8de0-7666f8f77fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.255706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450077be-d3f1-466e-8de0-7666f8f77fe6 None admin] RBAC: Adding query filter params (role.id=a90fc9cb49094b28b26944892f24382b, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=5e8b4acc54dc438ba2732633c8332706) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:15.256205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450077be-d3f1-466e-8de0-7666f8f77fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:15.259187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450077be-d3f1-466e-8de0-7666f8f77fe6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:15.272635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 129/255] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:14 2022] GET /identity/v3/role_assignments?user.id=5e8b4acc54dc438ba2732633c8332706&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=a90fc9cb49094b28b26944892f24382b => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:15.380200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b5ccd-1841-47bb-a498-5b8439d3d95a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:15.380200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b5ccd-1841-47bb-a498-5b8439d3d95a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:15.380200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b5ccd-1841-47bb-a498-5b8439d3d95a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.380200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 127/256] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:15.397500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9eca-3ea0-4338-8e9d-0ed2aa2e0e93 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:15.397963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9eca-3ea0-4338-8e9d-0ed2aa2e0e93 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:15.398519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc9eca-3ea0-4338-8e9d-0ed2aa2e0e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.442444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1cbc9eca-3ea0-4338-8e9d-0ed2aa2e0e93 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:15.444310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1cbc9eca-3ea0-4338-8e9d-0ed2aa2e0e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:15.570206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b5ccd-1841-47bb-a498-5b8439d3d95a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:15.598418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 130/257] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:15.706976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b5ccd-1841-47bb-a498-5b8439d3d95a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:15.735105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:15.758938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:15.759596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:15.759880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:15.760158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:15.773153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:15.780190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:15.781093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:15.782302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 128/258] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:15.789200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc9eca-3ea0-4338-8e9d-0ed2aa2e0e93 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:15.990743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:15.995811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc9eca-3ea0-4338-8e9d-0ed2aa2e0e93 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.062956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.063995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.064487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.064971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.066199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:16.067391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:16.070106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:16.087202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 131/259] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:16.092563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.235345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d4ade-9073-4745-a187-192d84c845ee None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.280106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.280765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.281048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.281324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] PATH_INFO: `/v3/users/3866d852093c47798c7972ac91d8ae22` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.282564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] RBAC: Authorizing `identity:get_user(user_id=3866d852093c47798c7972ac91d8ae22)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:16.284058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:16.286500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 129/260] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/users/3866d852093c47798c7972ac91d8ae22 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:16.293247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.512847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324d30-8ffd-4190-96e0-ac147d19db4f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.577348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.578315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.578806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.579285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.619437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.643289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:16.718767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:16.721531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:16.725281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:16.813111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928e5cf-0f17-4611-b58c-0fd851777f97 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:16.874181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:16.874782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:16.875061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:16.875335 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:16.892411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:16.904037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:16.904969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:16.906228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 130/261] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:16.916455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:16.940363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 132/262] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:16.956254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:17.120137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:17.178055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608cdf6-f729-4536-ad46-92a3ccd89b8d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.196737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:17.243310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1295e4-dea2-42a6-9b24-81cb5b4e73b5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.258917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.259649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.260017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.260497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.261494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:17.261796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.263253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.290835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 131/263] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:17.311710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:17.366572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.367871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.368365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.369249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.372171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.374784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.379443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 133/264] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:16 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:17.387799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:17.570766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2cf6-10f1-40d8-94a3-62ba1ef9cc51 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.666188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.668523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.669153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.670858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] PATH_INFO: `/v3/users/3866d852093c47798c7972ac91d8ae22` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.673410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] RBAC: Authorizing `identity:get_user(user_id=3866d852093c47798c7972ac91d8ae22)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.675269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.680494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 132/265] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:17 2022] GET /identity/v3/users/3866d852093c47798c7972ac91d8ae22 => generated 283 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:17.684975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f723dff-53d1-4cc8-90e6-ceb9649bafa2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:17.687858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:17.775208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:17.795170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:17.802790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:17.803385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:17.803855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:17.804810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] RBAC: Adding query filter params (role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=3866d852093c47798c7972ac91d8ae22) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:17.805319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:17.807180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:17.809786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:17.817562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 134/266] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:17 2022] GET /identity/v3/role_assignments?user.id=3866d852093c47798c7972ac91d8ae22&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 608 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:17.949455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94a4d9-4f42-44ad-b5fd-007bc770cea4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:18.024971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68debb7-fde3-4c2a-bd6f-875e54510fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:18.026061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68debb7-fde3-4c2a-bd6f-875e54510fdb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.026595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68debb7-fde3-4c2a-bd6f-875e54510fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.027095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68debb7-fde3-4c2a-bd6f-875e54510fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.159570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68debb7-fde3-4c2a-bd6f-875e54510fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:18.161987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68debb7-fde3-4c2a-bd6f-875e54510fdb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:18.210911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:18.283555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 133/267] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:01:18.293806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:18.549135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8780dfc-ca41-4b39-9ae7-1c226b6b674e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:18.621347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fafdb1-8168-49b8-8a9c-e6a0e2fb2286 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.622175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fafdb1-8168-49b8-8a9c-e6a0e2fb2286 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.622822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fafdb1-8168-49b8-8a9c-e6a0e2fb2286 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.625671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 134/268] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:18.635071 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69f31-8962-49d6-a3ef-27ff818e51c0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.635871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69f31-8962-49d6-a3ef-27ff818e51c0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.636571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69f31-8962-49d6-a3ef-27ff818e51c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.669663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:18.671111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.671771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.672439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.679425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:18.682375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:18.690115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 135/269] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:18 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:18.691361 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-30e69f31-8962-49d6-a3ef-27ff818e51c0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:18.693152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-30e69f31-8962-49d6-a3ef-27ff818e51c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:18.696461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:18.776480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 135/270] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:18.777791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f10cd-cca7-4f54-bf2b-4e7831be51dd None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.778230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f10cd-cca7-4f54-bf2b-4e7831be51dd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.778675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f10cd-cca7-4f54-bf2b-4e7831be51dd None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.780177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 136/271] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:18.791750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7bce-35cf-4707-bed8-1e4c5bc819af None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.792271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7bce-35cf-4707-bed8-1e4c5bc819af None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.792695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a7bce-35cf-4707-bed8-1e4c5bc819af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.811402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:18.829594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-777a7bce-35cf-4707-bed8-1e4c5bc819af None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:18.830863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-777a7bce-35cf-4707-bed8-1e4c5bc819af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:18.860765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0975-b81c-45dd-bff6-a9d00aea10d7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:18.903539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc51d-0891-40a4-bc45-4c5429bcf641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:18.904457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc51d-0891-40a4-bc45-4c5429bcf641 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.906300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc51d-0891-40a4-bc45-4c5429bcf641 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.906745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc51d-0891-40a4-bc45-4c5429bcf641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.908242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc51d-0891-40a4-bc45-4c5429bcf641 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=3866d852093c47798c7972ac91d8ae22) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:18.909176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc51d-0891-40a4-bc45-4c5429bcf641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:18.911875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc51d-0891-40a4-bc45-4c5429bcf641 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:18.928009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 136/272] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:18 2022] GET /identity/v3/role_assignments?user.id=3866d852093c47798c7972ac91d8ae22&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:18.931884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4942f-5af8-4b70-94aa-cd9a426a619e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.932533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4942f-5af8-4b70-94aa-cd9a426a619e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.934508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4942f-5af8-4b70-94aa-cd9a426a619e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.937059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 137/273] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:18.944416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cee1-7ecf-4e19-88fd-b763d57811bf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:18.946602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cee1-7ecf-4e19-88fd-b763d57811bf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:18.948056 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701cee1-7ecf-4e19-88fd-b763d57811bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:18.967845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:18.978185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 137/274] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:18.995400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0701cee1-7ecf-4e19-88fd-b763d57811bf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:18.996950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0701cee1-7ecf-4e19-88fd-b763d57811bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:19.128502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7bce-35cf-4707-bed8-1e4c5bc819af None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.180738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 138/275] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:19.255099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a7bce-35cf-4707-bed8-1e4c5bc819af None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.302388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.303428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.303919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.304412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.317264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:19.322651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:19.323536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:19.324319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:19.327041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 138/276] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:19.334607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701cee1-7ecf-4e19-88fd-b763d57811bf None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.340475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.428130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.444278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.497670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb0ae3-96d8-4cca-9848-db4981df05fd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.529725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701cee1-7ecf-4e19-88fd-b763d57811bf None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.539800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c54478-5050-4e8d-a441-3dff828ac097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.540451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54478-5050-4e8d-a441-3dff828ac097 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.540731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54478-5050-4e8d-a441-3dff828ac097 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.541003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54478-5050-4e8d-a441-3dff828ac097 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.542171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c54478-5050-4e8d-a441-3dff828ac097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.543714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c54478-5050-4e8d-a441-3dff828ac097 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.545655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 139/277] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:19.551545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77808c1-0ca1-442b-b6fc-0ae483861eef None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.551925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77808c1-0ca1-442b-b6fc-0ae483861eef None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.552218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77808c1-0ca1-442b-b6fc-0ae483861eef None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.553977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 140/278] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:19.554536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77808c1-0ca1-442b-b6fc-0ae483861eef None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.580023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146233ac-5aa0-453b-a5ca-f91703368edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.580992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146233ac-5aa0-453b-a5ca-f91703368edd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.581271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146233ac-5aa0-453b-a5ca-f91703368edd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.581548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146233ac-5aa0-453b-a5ca-f91703368edd None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.582835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146233ac-5aa0-453b-a5ca-f91703368edd None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:19.583293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146233ac-5aa0-453b-a5ca-f91703368edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.585358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146233ac-5aa0-453b-a5ca-f91703368edd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.603504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 139/279] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:19.604822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681dcfa-def5-429f-9e9b-a8a87a4d0186 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.605109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681dcfa-def5-429f-9e9b-a8a87a4d0186 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.605382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681dcfa-def5-429f-9e9b-a8a87a4d0186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.630329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1681dcfa-def5-429f-9e9b-a8a87a4d0186 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:19.631571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1681dcfa-def5-429f-9e9b-a8a87a4d0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:19.704348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77808c1-0ca1-442b-b6fc-0ae483861eef None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.725475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 140/280] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:19.727043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681dcfa-def5-429f-9e9b-a8a87a4d0186 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.750751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.767571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.768624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.769058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.769694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.770972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.773965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.821013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 141/281] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:19 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:19.821013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:19.837326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:19.928189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681dcfa-def5-429f-9e9b-a8a87a4d0186 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.972252 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:19.973571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:19.974382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:19.974885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] PATH_INFO: `/v3/users/4b85d8fd178844e28de1d64b281a819b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:19.991653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc54b21-8819-4bdb-883c-0a2d883c3125 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:19.992453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] RBAC: Authorizing `identity:get_user(user_id=4b85d8fd178844e28de1d64b281a819b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:19.994345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:19.996614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 141/282] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/users/4b85d8fd178844e28de1d64b281a819b => generated 293 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:20.003502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.040255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.040915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.041196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.041469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.054163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:20.059737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:20.060628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:20.061392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 142/283] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:20.062016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.119911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.136947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df1a47-0c43-4839-b536-dc460800f583 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.152898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.186363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.186987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.187269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.187539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.188867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, user.id=4b85d8fd178844e28de1d64b281a819b, scope.system=all) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:20.189191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.191041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.198433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 142/284] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/role_assignments?user.id=4b85d8fd178844e28de1d64b281a819b&scope.system=all&role.id=2d6361445523491fb757e0b12f225dcb => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:20.199749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.210166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dc372-7e09-425d-841a-47d7d35e2e06 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.291154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.292811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.293512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.294191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.317957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:20.330208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:20.332796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:20.334583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:20.338871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 143/285] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:20.349008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.351682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c784906-1315-4143-a80f-bac79cf68d4b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.393692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.394346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.394687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.394960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.395645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:20.395945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.397373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.408654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 143/286] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:20.419057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.478663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.540670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208266e-d781-4300-93aa-a89f9be68a62 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.557172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047fc229-b084-42d8-9195-bc40a637831d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.559182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.582016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.583678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.584136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.584553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] PATH_INFO: `/v3/users/d57eed1bf0894fdfa71407906a7f1338` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.585987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] RBAC: Authorizing `identity:get_user(user_id=d57eed1bf0894fdfa71407906a7f1338)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.590314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.594846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 144/287] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/users/d57eed1bf0894fdfa71407906a7f1338 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:20.601539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.651461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.652095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.652377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.652653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.653342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:20.653646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:20.655234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:20.670735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 144/288] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:20.679367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:20.814751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:20.823090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26d13e-5d48-4ff5-991a-cde2bb26a009 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:20.891129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:20.891803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:20.892132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:20.892415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:20.957656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb46a08-e3ec-4d4d-82b2-4a8fb10ce6d2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.034234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.037641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.076274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.077210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.077707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.078199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] PATH_INFO: `/v3/users/5e8b4acc54dc438ba2732633c8332706` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.083121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8b4acc54dc438ba2732633c8332706)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.086422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.090891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 145/289] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/users/5e8b4acc54dc438ba2732633c8332706 => generated 297 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:21.096680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.186227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.268547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.275991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 145/290] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:21.282722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.333982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2294e-8a80-4b80-9fc8-880db42a6888 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.386133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.387178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.387663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.388159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.389567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.391298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.393277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 146/291] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:21.399384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.472039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db7f9a-0154-495a-b3c8-99a15da29358 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.520980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.521946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.530716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.531000 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.532356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.533834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.536451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 146/292] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:21.542644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:21.609963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.615765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6676a1-5e37-4fd5-bd00-a87cef71a423 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.658279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:21.665734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fadd79-09d8-403b-a6e1-6ef960a2b56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.667814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadd79-09d8-403b-a6e1-6ef960a2b56e None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.669564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadd79-09d8-403b-a6e1-6ef960a2b56e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.670842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fadd79-09d8-403b-a6e1-6ef960a2b56e None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b/users/5e8b4acc54dc438ba2732633c8332706/roles/a90fc9cb49094b28b26944892f24382b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.677455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fadd79-09d8-403b-a6e1-6ef960a2b56e None admin] RBAC: Authorizing `identity:create_grant(project_id=e247570ef496410fa5831306e0872f1b, user_id=5e8b4acc54dc438ba2732633c8332706, role_id=a90fc9cb49094b28b26944892f24382b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.680704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fadd79-09d8-403b-a6e1-6ef960a2b56e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.700588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590e4bd-fe87-467e-bf72-4225d3741698 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:21.701561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 147/293] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:01:21 2022] PUT /identity/v3/projects/e247570ef496410fa5831306e0872f1b/users/5e8b4acc54dc438ba2732633c8332706/roles/a90fc9cb49094b28b26944892f24382b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:21.770346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29019a08-4318-4f7e-b745-b3c15783080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:21.771031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019a08-4318-4f7e-b745-b3c15783080a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:21.771317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019a08-4318-4f7e-b745-b3c15783080a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:21.771591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29019a08-4318-4f7e-b745-b3c15783080a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:21.772338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29019a08-4318-4f7e-b745-b3c15783080a None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=d57eed1bf0894fdfa71407906a7f1338) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:21.772648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29019a08-4318-4f7e-b745-b3c15783080a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:21.774106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29019a08-4318-4f7e-b745-b3c15783080a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:21.784491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 147/294] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:21 2022] GET /identity/v3/role_assignments?user.id=d57eed1bf0894fdfa71407906a7f1338&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=2d6361445523491fb757e0b12f225dcb => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:22.355528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025c9c-c3d9-4e4d-a219-291e561bf7d4 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.356098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025c9c-c3d9-4e4d-a219-291e561bf7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.356098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab025c9c-c3d9-4e4d-a219-291e561bf7d4 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.357883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 148/295] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:22.364190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b6154-5874-474a-85a8-e4e31deb2fb4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.365153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b6154-5874-474a-85a8-e4e31deb2fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.365657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b6154-5874-474a-85a8-e4e31deb2fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.385844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fb4b6154-5874-474a-85a8-e4e31deb2fb4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:22.387462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb4b6154-5874-474a-85a8-e4e31deb2fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:22.482298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 148/296] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:22.506209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d5595-f16f-4a48-84e2-f191dc6a734e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.506895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d5595-f16f-4a48-84e2-f191dc6a734e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.507369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d5595-f16f-4a48-84e2-f191dc6a734e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.508950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 149/297] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:22.514787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaf7-19fc-4658-865b-5e744760560f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.515080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaf7-19fc-4658-865b-5e744760560f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.515359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaf7-19fc-4658-865b-5e744760560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.538998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a3f9aaf7-19fc-4658-865b-5e744760560f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:22.540875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a3f9aaf7-19fc-4658-865b-5e744760560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:22.614101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:22.626494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 149/298] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:22.644463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0429-e8ca-4a43-9e67-200b09f79f85 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.645055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0429-e8ca-4a43-9e67-200b09f79f85 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.645667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0429-e8ca-4a43-9e67-200b09f79f85 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.647678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 150/299] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:22.657003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec629b-134b-4ac2-b759-93d19971a175 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.657469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec629b-134b-4ac2-b759-93d19971a175 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.657922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec629b-134b-4ac2-b759-93d19971a175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.686857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-17ec629b-134b-4ac2-b759-93d19971a175 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:22.688085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-17ec629b-134b-4ac2-b759-93d19971a175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:22.768611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 150/300] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:22.792433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb0429-e8ca-4a43-9e67-200b09f79f85 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:22.909523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb0429-e8ca-4a43-9e67-200b09f79f85 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:22.948880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:22.949767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:22.950190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:22.950659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:22.964945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:22.970191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:22.971286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:22.972231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:22.974999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 151/301] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:22.981797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec629b-134b-4ac2-b759-93d19971a175 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.090474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.099207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec629b-134b-4ac2-b759-93d19971a175 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.118395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.127326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.143192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.143826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.144099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.145261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.146153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:23.146508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.147955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.161714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 151/302] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:23.161714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.255013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7eacc-ea2e-4ed9-b666-de8221d7e65e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.297532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.298326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.298613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.298890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.300099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.301796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.303791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 152/303] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:23.304434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.312152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b016505-9a97-4cc3-9c91-4a359cd2e0bb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.366545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.367706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.368135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.368619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.385862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:23.391590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:23.392542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:23.393295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 152/304] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:23.393935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.432726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.447229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86149c-ee37-4903-9fd2-cc97ffcd5d85 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.453900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.498358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.499471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.499920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.500398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] PATH_INFO: `/v3/users/2ad92d07128d4a31a75805e45bd6a341` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.523892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad92d07128d4a31a75805e45bd6a341)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.525383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.527915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 153/305] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/users/2ad92d07128d4a31a75805e45bd6a341 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:23.532180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.545318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88197a7e-b67b-4891-aa4b-bb51d3edb4c5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.622788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.623776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.624241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.624990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] PATH_INFO: `/v3/groups` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.625518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.628101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.649988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 153/306] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Sep 1 08:01:23 2022] POST /identity/v3/groups => generated 229 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:23.651586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.703985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc2295-cdfe-4d87-af22-ef714dc4e699 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.749441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.750495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.751007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.751500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.752479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:23.753000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.754987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.768022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 154/307] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:23.777168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:23.802760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.905391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8598a-5eed-45c4-95c1-81e7b267ce99 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.908916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:23.944228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6a918-aa98-4318-a2bf-441f0fe09bca None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:23.962010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:23.963044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:23.963527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:23.964011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:23.965568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] RBAC: Adding query filter params (role.id=a90fc9cb49094b28b26944892f24382b, user.id=2ad92d07128d4a31a75805e45bd6a341, scope.system=all) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:23.965995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:23.968612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:23.977308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 154/308] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/role_assignments?user.id=2ad92d07128d4a31a75805e45bd6a341&scope.system=all&role.id=a90fc9cb49094b28b26944892f24382b => generated 226 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:24.011320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96851389-c9e6-4cb2-804e-ecc711bae5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:24.011995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851389-c9e6-4cb2-804e-ecc711bae5fd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:24.012282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851389-c9e6-4cb2-804e-ecc711bae5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:24.012564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96851389-c9e6-4cb2-804e-ecc711bae5fd None admin] PATH_INFO: `/v3/users/4b85d8fd178844e28de1d64b281a819b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:24.013868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851389-c9e6-4cb2-804e-ecc711bae5fd None admin] RBAC: Authorizing `identity:get_user(user_id=4b85d8fd178844e28de1d64b281a819b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:24.015569 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96851389-c9e6-4cb2-804e-ecc711bae5fd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:24.017732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 155/309] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:23 2022] GET /identity/v3/users/4b85d8fd178844e28de1d64b281a819b => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:24.027311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:24.225570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd4420-c683-4eda-9142-11e175c29d90 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:24.225935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd4420-c683-4eda-9142-11e175c29d90 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:24.226036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd4420-c683-4eda-9142-11e175c29d90 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:24.226544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805b080-bbdb-4e18-9650-e0d170046f3f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:24.228923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 156/310] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:24.233581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59c8d-daf3-4ec9-b9b7-7e969cc71c37 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:24.233861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59c8d-daf3-4ec9-b9b7-7e969cc71c37 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:24.234138 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df59c8d-daf3-4ec9-b9b7-7e969cc71c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:24.255565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9df59c8d-daf3-4ec9-b9b7-7e969cc71c37 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:24.256860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9df59c8d-daf3-4ec9-b9b7-7e969cc71c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:24.297120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:24.299416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:24.300245 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:24.300760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] PATH_INFO: `/v3/system/users/4b85d8fd178844e28de1d64b281a819b/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:24.303690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4b85d8fd178844e28de1d64b281a819b, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:24.306735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:24.326827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 155/311] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Sep 1 08:01:24 2022] PUT /identity/v3/system/users/4b85d8fd178844e28de1d64b281a819b/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:24.366092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 157/312] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:24.666123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:24.724703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:24.862136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a25dc1-bc9b-4a0f-a317-eb5e6a2c12ec None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:24.927066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:24.928162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:24.928655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:24.929465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:24.950723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:24.961922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:24.962974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:24.963771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:24.965251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 156/313] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:24.974849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59c8d-daf3-4ec9-b9b7-7e969cc71c37 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:24.992391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:25.154659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df59c8d-daf3-4ec9-b9b7-7e969cc71c37 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:25.196215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:25.196855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:25.197126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:25.197399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:25.198102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:25.198440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:25.199906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:25.210321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 158/314] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:25.220423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:25.364017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:25.374038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84790ca-66f5-4548-ac08-802efd42fa22 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:25.414467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:25.415011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:25.415327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:25.415578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] PATH_INFO: `/v3/users/5e8b4acc54dc438ba2732633c8332706` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:25.416769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] RBAC: Authorizing `identity:get_user(user_id=5e8b4acc54dc438ba2732633c8332706)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:25.418272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:25.420209 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 157/315] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:25 2022] GET /identity/v3/users/5e8b4acc54dc438ba2732633c8332706 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:25.430195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:25.542125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:25.584286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a791bf-cd2b-4779-8ad1-a48d6c9678e4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:25.624549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:25.625174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:25.625456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:25.625708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:25.708341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:25.709746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:25.780732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:25.820892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 159/316] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:25.829630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:25.962759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8266d-c0fe-4f89-b0a0-4913196e8426 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.006697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0e545-4c24-47c2-8b6f-f86d6db32901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.007340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e545-4c24-47c2-8b6f-f86d6db32901 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.007622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e545-4c24-47c2-8b6f-f86d6db32901 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.007899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0e545-4c24-47c2-8b6f-f86d6db32901 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.009052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e545-4c24-47c2-8b6f-f86d6db32901 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.010564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0e545-4c24-47c2-8b6f-f86d6db32901 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.012250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 158/317] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:25 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:26.018856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.129758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2992-b61a-4759-a64c-15d7d8e94111 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.130101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2992-b61a-4759-a64c-15d7d8e94111 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.130363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d2992-b61a-4759-a64c-15d7d8e94111 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.131723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 159/318] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:26.135827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af5c6-f8f7-444c-ba5b-f30091a92f36 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.137853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87673789-d2e7-4bab-86c0-208651110665 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.138390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87673789-d2e7-4bab-86c0-208651110665 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.138869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87673789-d2e7-4bab-86c0-208651110665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.159013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-87673789-d2e7-4bab-86c0-208651110665 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:26.160805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-87673789-d2e7-4bab-86c0-208651110665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:26.178803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415eac5-4f14-4c84-a1af-a42c2f7b0c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.179445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415eac5-4f14-4c84-a1af-a42c2f7b0c5d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.179728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415eac5-4f14-4c84-a1af-a42c2f7b0c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.180002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415eac5-4f14-4c84-a1af-a42c2f7b0c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.180778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415eac5-4f14-4c84-a1af-a42c2f7b0c5d None admin] RBAC: Adding query filter params (role.id=a90fc9cb49094b28b26944892f24382b, scope.project.id=e247570ef496410fa5831306e0872f1b, user.id=5e8b4acc54dc438ba2732633c8332706) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:26.181082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415eac5-4f14-4c84-a1af-a42c2f7b0c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.182586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415eac5-4f14-4c84-a1af-a42c2f7b0c5d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.189256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.189432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 160/319] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/role_assignments?user.id=5e8b4acc54dc438ba2732633c8332706&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=a90fc9cb49094b28b26944892f24382b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:26.197350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac392-c025-49a7-8152-555efe03b9e2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.198317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac392-c025-49a7-8152-555efe03b9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.199403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ac392-c025-49a7-8152-555efe03b9e2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.201832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 161/320] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:26.208126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598761-66b6-43d1-ab37-c6f1badce145 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.208529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598761-66b6-43d1-ab37-c6f1badce145 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.208702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e598761-66b6-43d1-ab37-c6f1badce145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.229575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4e598761-66b6-43d1-ab37-c6f1badce145 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:26.230777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4e598761-66b6-43d1-ab37-c6f1badce145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:26.254219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 160/321] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:26.271875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.326746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 162/322] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:26.547735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87673789-d2e7-4bab-86c0-208651110665 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.614102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598761-66b6-43d1-ab37-c6f1badce145 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.681987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87673789-d2e7-4bab-86c0-208651110665 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.723536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.724307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.724589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.724864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.739027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:26.744108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:26.745027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:26.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 161/323] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:26.751745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.759480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e598761-66b6-43d1-ab37-c6f1badce145 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.774108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.816247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.817243 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.817737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.818204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.820214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.823057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.833787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 163/324] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:26.835411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.878510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:26.880304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4dbfb-3786-4543-a485-0022cf794afc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:26.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb207a-5488-4aa9-b8ef-e986d1555476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:26.918755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb207a-5488-4aa9-b8ef-e986d1555476 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.919025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb207a-5488-4aa9-b8ef-e986d1555476 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.919306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb207a-5488-4aa9-b8ef-e986d1555476 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.919996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb207a-5488-4aa9-b8ef-e986d1555476 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:26.920292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb207a-5488-4aa9-b8ef-e986d1555476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:26.921727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb207a-5488-4aa9-b8ef-e986d1555476 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:26.931564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 162/325] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:26.932964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c54a8-7f51-4445-8fef-d64002062d45 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:26.933251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c54a8-7f51-4445-8fef-d64002062d45 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:26.933521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c54a8-7f51-4445-8fef-d64002062d45 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:26.934853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 163/326] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:26.939683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c54a8-7f51-4445-8fef-d64002062d45 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:26.963761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59fc52-ff1e-44e7-812d-2cb1f25bf550 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:27.001395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536784c9-9bd7-4766-89a3-17f3302b835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:27.002014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536784c9-9bd7-4766-89a3-17f3302b835b None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.002322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536784c9-9bd7-4766-89a3-17f3302b835b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.002599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536784c9-9bd7-4766-89a3-17f3302b835b None admin] PATH_INFO: `/v3/groups` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.003245 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536784c9-9bd7-4766-89a3-17f3302b835b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:27.005393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536784c9-9bd7-4766-89a3-17f3302b835b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:27.024315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 164/327] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Sep 1 08:01:26 2022] POST /identity/v3/groups => generated 226 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:27.025578 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df435-5db4-49ca-b992-425290293a39 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.025859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df435-5db4-49ca-b992-425290293a39 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.026128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df435-5db4-49ca-b992-425290293a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.040844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:27.047948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a81df435-5db4-49ca-b992-425290293a39 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:27.049230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a81df435-5db4-49ca-b992-425290293a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:27.071027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c54a8-7f51-4445-8fef-d64002062d45 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:27.119315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:27.120170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.120586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.120988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] PATH_INFO: `/v3/users/2ad92d07128d4a31a75805e45bd6a341` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.123322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] RBAC: Authorizing `identity:get_user(user_id=2ad92d07128d4a31a75805e45bd6a341)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:27.125108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:27.133986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 164/328] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:26 2022] GET /identity/v3/users/2ad92d07128d4a31a75805e45bd6a341 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:27.136391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:27.140198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 165/329] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:27.297643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea68a361-e19d-4b0c-a1f5-502bec48b60c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:27.354216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:27.354891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.355163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.355430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] PATH_INFO: `/v3/system/users/2ad92d07128d4a31a75805e45bd6a341/roles/a90fc9cb49094b28b26944892f24382b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.356971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ad92d07128d4a31a75805e45bd6a341, role_id=a90fc9cb49094b28b26944892f24382b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:27.358426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:27.368096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 165/330] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Sep 1 08:01:27 2022] PUT /identity/v3/system/users/2ad92d07128d4a31a75805e45bd6a341/roles/a90fc9cb49094b28b26944892f24382b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:01:27.520072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df435-5db4-49ca-b992-425290293a39 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:27.568153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:27.732998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df435-5db4-49ca-b992-425290293a39 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:27.810947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:27.812391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:27.813072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:27.813769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:27.838513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:27.848228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:27.849992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:27.851595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 166/331] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:27.867541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:27.899790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.011697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9bf2e-14ea-4412-832b-1a149e5fff76 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.053387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.054025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.054318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.054579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.055257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:28.055555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.056973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.067561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 166/332] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:28.073088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.227421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.277016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bddb76-1333-4ab9-a3c4-309839d11c20 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.372553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe597c-5e53-4e43-9c10-bcf8f6e70bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.373686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe597c-5e53-4e43-9c10-bcf8f6e70bfa None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.374182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe597c-5e53-4e43-9c10-bcf8f6e70bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.374710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe597c-5e53-4e43-9c10-bcf8f6e70bfa None admin] PATH_INFO: `/v3/users/4b85d8fd178844e28de1d64b281a819b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.377009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe597c-5e53-4e43-9c10-bcf8f6e70bfa None admin] RBAC: Authorizing `identity:get_user(user_id=4b85d8fd178844e28de1d64b281a819b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.380189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe597c-5e53-4e43-9c10-bcf8f6e70bfa None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.383444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 167/333] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:28 2022] GET /identity/v3/users/4b85d8fd178844e28de1d64b281a819b => generated 293 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:28.390650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:28.563145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:28.607206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678ee9-559d-4337-9937-7f8b40495f5c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:28.651279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca93dd-fd76-436b-b61e-73b359308713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:28.651912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca93dd-fd76-436b-b61e-73b359308713 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:28.652196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca93dd-fd76-436b-b61e-73b359308713 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:28.652471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca93dd-fd76-436b-b61e-73b359308713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:28.653222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca93dd-fd76-436b-b61e-73b359308713 None admin] RBAC: Adding query filter params (role.id=2d6361445523491fb757e0b12f225dcb, user.id=4b85d8fd178844e28de1d64b281a819b, scope.system=all) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:28.653534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca93dd-fd76-436b-b61e-73b359308713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:28.656273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca93dd-fd76-436b-b61e-73b359308713 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:28.677612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 167/334] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:28 2022] GET /identity/v3/role_assignments?user.id=4b85d8fd178844e28de1d64b281a819b&scope.system=all&role.id=2d6361445523491fb757e0b12f225dcb => generated 510 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:29.785926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561384-01c7-4923-9c8e-61618ff8372d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.787574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561384-01c7-4923-9c8e-61618ff8372d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.788336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c561384-01c7-4923-9c8e-61618ff8372d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.791667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 168/335] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:29.798010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fc0db-6255-4bcb-86ab-e8462f8b1723 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:29.799493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fc0db-6255-4bcb-86ab-e8462f8b1723 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:29.800796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fc0db-6255-4bcb-86ab-e8462f8b1723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:29.842500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8c1fc0db-6255-4bcb-86ab-e8462f8b1723 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:29.845104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8c1fc0db-6255-4bcb-86ab-e8462f8b1723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:29.979789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:30.266504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e5e6-cb06-4dc7-a9a5-26e8d393e89a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:30.267514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e5e6-cb06-4dc7-a9a5-26e8d393e89a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:30.268264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4e5e6-cb06-4dc7-a9a5-26e8d393e89a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:30.272408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 169/337] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:30.277593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0068d7-e53a-4d07-b89f-1f2042c741cb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:30.277975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0068d7-e53a-4d07-b89f-1f2042c741cb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:30.278228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0068d7-e53a-4d07-b89f-1f2042c741cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:30.311388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-da0068d7-e53a-4d07-b89f-1f2042c741cb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:30.312631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-da0068d7-e53a-4d07-b89f-1f2042c741cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:30.393885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:30.407832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 169/338] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:30.562964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e5e6-cb06-4dc7-a9a5-26e8d393e89a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:30.704156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4e5e6-cb06-4dc7-a9a5-26e8d393e89a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:30.751554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:30.752220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:30.752502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:30.752785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:30.772552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:30.777592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:30.779297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:30.780855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 170/339] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:30.791974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0068d7-e53a-4d07-b89f-1f2042c741cb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:30.948188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0068d7-e53a-4d07-b89f-1f2042c741cb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:30.988108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae7f96-a8b1-4236-bc71-b7eaa8b7d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:30.988696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7f96-a8b1-4236-bc71-b7eaa8b7d862 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:30.989124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7f96-a8b1-4236-bc71-b7eaa8b7d862 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:30.989377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae7f96-a8b1-4236-bc71-b7eaa8b7d862 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:30.990062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7f96-a8b1-4236-bc71-b7eaa8b7d862 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:30.990389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7f96-a8b1-4236-bc71-b7eaa8b7d862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:30.991789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae7f96-a8b1-4236-bc71-b7eaa8b7d862 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.007693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 170/340] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:31.016294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.037296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.085162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468922-ed01-4230-a6af-0d6cdbdbf9ba None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.085578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468922-ed01-4230-a6af-0d6cdbdbf9ba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.085810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd468922-ed01-4230-a6af-0d6cdbdbf9ba None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.087346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 171/341] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:01:31.093951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704c46-69b9-4e8c-b205-cbffffc667e8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.094367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704c46-69b9-4e8c-b205-cbffffc667e8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.094567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704c46-69b9-4e8c-b205-cbffffc667e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.124233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-78704c46-69b9-4e8c-b205-cbffffc667e8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:31.125455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-78704c46-69b9-4e8c-b205-cbffffc667e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:31.196113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.213454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4527f-0529-416c-897d-15c31c9b07f7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.234279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 172/342] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:31.238263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78704c46-69b9-4e8c-b205-cbffffc667e8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.293042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85d340-d4c6-440b-875e-f94b78152edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.294076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d340-d4c6-440b-875e-f94b78152edf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.294566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d340-d4c6-440b-875e-f94b78152edf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.295029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85d340-d4c6-440b-875e-f94b78152edf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.383293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78704c46-69b9-4e8c-b205-cbffffc667e8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.449426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d340-d4c6-440b-875e-f94b78152edf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.449808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac06585-dd9d-4862-9590-85d0776d3be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.450436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac06585-dd9d-4862-9590-85d0776d3be1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.450721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac06585-dd9d-4862-9590-85d0776d3be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.450993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac06585-dd9d-4862-9590-85d0776d3be1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.452259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85d340-d4c6-440b-875e-f94b78152edf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.465457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.477498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac06585-dd9d-4862-9590-85d0776d3be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2ac06585-dd9d-4862-9590-85d0776d3be1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:31.489775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:31.490773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:31.491530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:31.492105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 173/343] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:31.493939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2161d7-657f-4899-99d8-67875bf26cf9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.498655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2161d7-657f-4899-99d8-67875bf26cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.499209 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2161d7-657f-4899-99d8-67875bf26cf9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.501777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 174/344] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:31.507334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2161d7-657f-4899-99d8-67875bf26cf9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.606772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 171/345] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:31.608383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30a1b-efa1-4c3a-8985-fb14f6e85206 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.608881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30a1b-efa1-4c3a-8985-fb14f6e85206 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.609360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a30a1b-efa1-4c3a-8985-fb14f6e85206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.620171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.647886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c7a30a1b-efa1-4c3a-8985-fb14f6e85206 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:31.649840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c7a30a1b-efa1-4c3a-8985-fb14f6e85206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:31.728965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2161d7-657f-4899-99d8-67875bf26cf9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.756510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 172/346] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:31.757876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a30a1b-efa1-4c3a-8985-fb14f6e85206 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.801730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.802927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.803366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.803824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.805067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:31.805575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.808402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.827761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:31.828818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 175/347] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:31.839154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:31.918603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a30a1b-efa1-4c3a-8985-fb14f6e85206 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:31.967813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:31.968844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:31.969329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:31.969806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:31.971547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:31.974156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:31.976253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 173/348] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:31.982403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.062814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012aad0-454b-49ad-9c52-490e8dbbccf2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.077696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.104901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29d8e2-d019-4def-8975-410f74ebc9da None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.114174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.150062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.150809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.151088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.151612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.158967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.162273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.164021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 174/349] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:32.164918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.194269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd804051-b404-422d-9537-1318a8feeeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.194269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804051-b404-422d-9537-1318a8feeeb7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.194657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804051-b404-422d-9537-1318a8feeeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.194657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd804051-b404-422d-9537-1318a8feeeb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.294544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd804051-b404-422d-9537-1318a8feeeb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.296173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd804051-b404-422d-9537-1318a8feeeb7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.317944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0eea10-bae7-4a17-be49-1fc19a9cf3da None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.355141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.355793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.356060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.356333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.368595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:32.374076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:32.376490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 175/350] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:32.379438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.415472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.440672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 176/351] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:32.444274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefe2f-2885-4fd7-9d04-587259bea008 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.446588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefe2f-2885-4fd7-9d04-587259bea008 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.447547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcefe2f-2885-4fd7-9d04-587259bea008 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.450491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 177/352] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:32.452067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcefe2f-2885-4fd7-9d04-587259bea008 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.471422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.521173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42916bc5-e36e-4de4-99fa-8ec9affa7a83 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.616820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.617448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.617737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.618019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.621766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:32.621766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.621766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.631684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 176/353] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=2d6361445523491fb757e0b12f225dcb => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:32.633798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.647550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcefe2f-2885-4fd7-9d04-587259bea008 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.699987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab80c-fcb7-435e-80c0-d5b102254fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.700634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab80c-fcb7-435e-80c0-d5b102254fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.700912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab80c-fcb7-435e-80c0-d5b102254fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.701183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab80c-fcb7-435e-80c0-d5b102254fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.701872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab80c-fcb7-435e-80c0-d5b102254fe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:32.702169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab80c-fcb7-435e-80c0-d5b102254fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.703762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab80c-fcb7-435e-80c0-d5b102254fe1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.714575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 178/354] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:32.715985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd158e7-b1cc-4169-9a31-ecb2922fa377 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.724584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd158e7-b1cc-4169-9a31-ecb2922fa377 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.724990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd158e7-b1cc-4169-9a31-ecb2922fa377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.748792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0bd158e7-b1cc-4169-9a31-ecb2922fa377 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:32.750066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0bd158e7-b1cc-4169-9a31-ecb2922fa377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:32.844334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.853636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 179/355] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:32.856130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd158e7-b1cc-4169-9a31-ecb2922fa377 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:32.867478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:32.889369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc09a7-c4d6-4478-8e7a-96bfeadcab64 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:32.953184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:32.954722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:32.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:32.955922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:32.958640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:32.961508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:32.964157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 177/356] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:32.965203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.068536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd158e7-b1cc-4169-9a31-ecb2922fa377 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.118167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a8a7c-f1e7-4756-989f-b5dc37b38cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:33.119582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8a7c-f1e7-4756-989f-b5dc37b38cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.119582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8a7c-f1e7-4756-989f-b5dc37b38cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.119749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a8a7c-f1e7-4756-989f-b5dc37b38cb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.124793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29554de9-db63-4d13-9f2c-02b1f7a6d4c6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.133851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a8a7c-f1e7-4756-989f-b5dc37b38cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a44a8a7c-f1e7-4756-989f-b5dc37b38cb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:33.139008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:33.139950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:33.140715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 180/357] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:33.142098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415cb26-9793-418a-9ecc-87b563318fce None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.142098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415cb26-9793-418a-9ecc-87b563318fce None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.142098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415cb26-9793-418a-9ecc-87b563318fce None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.145572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 181/358] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:33.146526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415cb26-9793-418a-9ecc-87b563318fce None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.180890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c889-421c-49b1-ad86-07dc011503c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:33.182211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c889-421c-49b1-ad86-07dc011503c1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.183267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c889-421c-49b1-ad86-07dc011503c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.183805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c889-421c-49b1-ad86-07dc011503c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.227496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:33.232665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:33.290082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502c889-421c-49b1-ad86-07dc011503c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:33.292664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502c889-421c-49b1-ad86-07dc011503c1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:33.294704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415cb26-9793-418a-9ecc-87b563318fce None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.349666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:33.350370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.350658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.350934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.352170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:33.353657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:33.356915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 182/359] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:33 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:33.357743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.454504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 178/360] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:33.456040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967347f-e254-440a-9c27-ad654ad119ea None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.456248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967347f-e254-440a-9c27-ad654ad119ea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.457082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967347f-e254-440a-9c27-ad654ad119ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.478852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6967347f-e254-440a-9c27-ad654ad119ea None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:33.480203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6967347f-e254-440a-9c27-ad654ad119ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:33.511194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d419ab-a659-4917-a253-7306e6cc09ea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.561788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:33.570087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:33.582201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:33.584393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.584955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.585231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 179/361] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:33.585710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.586127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967347f-e254-440a-9c27-ad654ad119ea None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.586982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:33.587511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:33.589270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:33.600002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 183/362] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:33.600888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.740599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967347f-e254-440a-9c27-ad654ad119ea None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.746007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b29c8c-16ca-4376-9a9e-4562f7902c21 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.794892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:33.795817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.796246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.796669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.797642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:33.798341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:33.798461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:33.798837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:33.799198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:33.800067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=e247570ef496410fa5831306e0872f1b) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:33.800664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:33.800927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:33.802399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:33.803280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 184/363] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:33 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:33.807347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.812456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 180/364] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:33 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=2d6361445523491fb757e0b12f225dcb => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:33.813305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:33.892114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:33.899306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:33.953718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ad2b3-8099-4183-b5ec-8b1b9d13eb1f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:33.953919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89e757-2f1e-43c0-b015-124af2657a41 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.000036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.000777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.001157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.001535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] PATH_INFO: `/v3/users/2ad92d07128d4a31a75805e45bd6a341` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.002885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] RBAC: Authorizing `identity:get_user(user_id=2ad92d07128d4a31a75805e45bd6a341)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:34.004376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.005368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.005630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:34.005934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.006373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.008086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 181/365] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:01:33 2022] GET /identity/v3/users/2ad92d07128d4a31a75805e45bd6a341 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:34.009239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.025890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:34.032007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:34.033113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:34.034139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:34.042355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 185/366] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:34.043831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.229463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412f2a0-e8a5-4a65-99db-8114d8eaccbf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.276562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96e02f-a5a0-4206-9ae1-cac2b95a2718 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.283305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:34.303637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:34.311882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.313432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.314443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.315804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.318104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:34.320863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:34.329091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 182/367] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:34.329091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.336593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.337608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.338094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.338607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.339563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] RBAC: Adding query filter params (role.id=a90fc9cb49094b28b26944892f24382b, user.id=2ad92d07128d4a31a75805e45bd6a341, scope.system=all) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:34.340134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:34.341813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:34.357527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 186/368] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/role_assignments?user.id=2ad92d07128d4a31a75805e45bd6a341&scope.system=all&role.id=a90fc9cb49094b28b26944892f24382b => generated 510 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:34.358887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.486602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa9621-7a9c-467b-a729-83a94853b364 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.531657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.533154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.533646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.534177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.538289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731dec4-b698-443c-b87e-a45c6e375c09 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.548964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:34.556368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:34.557320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:34.558119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:34.561944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 187/369] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:34.563159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.613134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:34.639384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.640958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.641744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.642547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.644759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:34.645773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:34.648708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:34.682101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 183/370] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:34.684890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.763229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:34.778214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b34a6-18fe-4cd5-a60d-777ffb169850 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.835872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a8bf-b8b7-45ab-9743-34ae01a7d0ec None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:34.873417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.875562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.876391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.877235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.879907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:34.881020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:34.885638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:34.893099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:34.893964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:34.894383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:34.894958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:34.895737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:34.897089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:34.898550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 188/371] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 260 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:34.900254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:34.902692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:34.928156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 184/372] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:34.934864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:35.115828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.124304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50b3c5-1e37-4027-91ef-2973d711ee1a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:35.198386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:35.200785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.201586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.202339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.206113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1782b6-b03e-41ff-a9fc-364947fbd73a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:35.252698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.296474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:35.297104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.297402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.297646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.358939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:35.362346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:35.494417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:35.497636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:35.655565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 185/373] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:35.657944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:35.687064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 189/374] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:35.691383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.698398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:35.701080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:35.864073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea74af-b44d-412b-8039-28f6fa527702 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:35.944720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:35.946776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:35.947603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:35.957365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] PATH_INFO: `/v3/projects/7901ef731efb4e4d9c32801133aae298` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:35.960217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] RBAC: Authorizing `identity:get_project(project_id=7901ef731efb4e4d9c32801133aae298)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:35.963626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:35.971816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 186/375] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:35 2022] GET /identity/v3/projects/7901ef731efb4e4d9c32801133aae298 => generated 344 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:35.982493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.007976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddff2ac-11b1-4a13-a602-2df571db3db0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.049757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d72ce-c3f0-4f43-9c0a-f4992bd56a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.050672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d72ce-c3f0-4f43-9c0a-f4992bd56a6a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.051117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d72ce-c3f0-4f43-9c0a-f4992bd56a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.051448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d72ce-c3f0-4f43-9c0a-f4992bd56a6a None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.052672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d72ce-c3f0-4f43-9c0a-f4992bd56a6a None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.054161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d72ce-c3f0-4f43-9c0a-f4992bd56a6a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.057531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 190/376] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:35 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:36.059223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff901-c296-4bef-96d4-cc3f99ce8284 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.059528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff901-c296-4bef-96d4-cc3f99ce8284 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.059774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eff901-c296-4bef-96d4-cc3f99ce8284 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.065313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 191/377] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:36.067092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eff901-c296-4bef-96d4-cc3f99ce8284 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.148834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:36.175448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:36.193102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eff901-c296-4bef-96d4-cc3f99ce8284 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.212933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850e5a2-b67a-4e21-9ce8-9194c8446d70 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.237035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e42df5-9f9f-495e-a760-592ab26eb797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.237722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42df5-9f9f-495e-a760-592ab26eb797 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.238098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42df5-9f9f-495e-a760-592ab26eb797 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.238631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e42df5-9f9f-495e-a760-592ab26eb797 None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.240735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e42df5-9f9f-495e-a760-592ab26eb797 None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.241960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e42df5-9f9f-495e-a760-592ab26eb797 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.246002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 192/378] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:36.246910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c69-00d8-4f62-89de-2eb48e2cbf41 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.247190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c69-00d8-4f62-89de-2eb48e2cbf41 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.247465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e06c69-00d8-4f62-89de-2eb48e2cbf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.270573 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-39e06c69-00d8-4f62-89de-2eb48e2cbf41 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:36.271856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-39e06c69-00d8-4f62-89de-2eb48e2cbf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:36.295818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.297952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.298740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.299469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] PATH_INFO: `/v3/groups/3dd183ee1fcb48c1808c0db571c2e362` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.311019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] RBAC: Authorizing `identity:get_group(group_id=3dd183ee1fcb48c1808c0db571c2e362)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.313928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.317806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 187/379] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:35 2022] GET /identity/v3/groups/3dd183ee1fcb48c1808c0db571c2e362 => generated 229 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:36.321322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.362017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 193/380] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:36.362017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06c69-00d8-4f62-89de-2eb48e2cbf41 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:36.446359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:36.501362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e06c69-00d8-4f62-89de-2eb48e2cbf41 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.535126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d3aff-1262-41a1-a1de-065c70b993ba None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:36.550299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.552159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.552665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.553164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.554111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] RBAC: Adding query filter params (group.id=3dd183ee1fcb48c1808c0db571c2e362, role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=7901ef731efb4e4d9c32801133aae298) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:36.554694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.557105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.565314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 194/381] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/role_assignments?group.id=3dd183ee1fcb48c1808c0db571c2e362&scope.project.id=7901ef731efb4e4d9c32801133aae298&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:36.623716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:36.624605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:36.625101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:36.625581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:36.627064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=e247570ef496410fa5831306e0872f1b) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:36.627617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:36.631080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:36.643503 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 188/382] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 260 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:36.819814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.004648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba01e3-dcd4-4d92-adb2-743a5ee2c074 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.057023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.072545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.073441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.073868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.074376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.092280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:37.098760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:37.099869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:37.100876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:37.103336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 195/383] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:37.109222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.134499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.242892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f623f3-1df4-46e4-93ba-548d99997c48 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.284278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc2972-df4c-4452-b254-8d525842a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.285753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2972-df4c-4452-b254-8d525842a57b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.286202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2972-df4c-4452-b254-8d525842a57b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.286520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc2972-df4c-4452-b254-8d525842a57b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.287259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2972-df4c-4452-b254-8d525842a57b None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:37.287563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2972-df4c-4452-b254-8d525842a57b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.289128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc2972-df4c-4452-b254-8d525842a57b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.299858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 189/384] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:37.306074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.398572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d525a4-6576-4386-949b-c19996e87d6a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.398811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d525a4-6576-4386-949b-c19996e87d6a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.399108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d525a4-6576-4386-949b-c19996e87d6a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.406387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 190/385] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:37.413266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4e6ee-8549-4da7-9d70-5af12a4d7b77 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.413682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4e6ee-8549-4da7-9d70-5af12a4d7b77 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.413814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4e6ee-8549-4da7-9d70-5af12a4d7b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.470546 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dab4e6ee-8549-4da7-9d70-5af12a4d7b77 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:37.475580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dab4e6ee-8549-4da7-9d70-5af12a4d7b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:37.627282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a1869-cc29-4b4d-aec5-9d3569ffefe8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.657368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 191/386] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:37.704877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.706354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.707140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.707901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.710193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.712794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.722977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 196/387] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:37.725239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4e6ee-8549-4da7-9d70-5af12a4d7b77 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:37.731736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:37.866701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4e6ee-8549-4da7-9d70-5af12a4d7b77 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:37.910623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:37.911190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:37.911462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:37.911729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:37.912978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:37.914563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:37.916734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 192/388] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:37 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:37.926332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.084214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.100463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.160571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6083865-91ab-4ee4-9c52-cf1a51de48f1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.213844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ac723-8121-4fe4-91be-3e8be7ba473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.215210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ac723-8121-4fe4-91be-3e8be7ba473f None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.215325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ac723-8121-4fe4-91be-3e8be7ba473f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.215755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ac723-8121-4fe4-91be-3e8be7ba473f None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.222943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ac723-8121-4fe4-91be-3e8be7ba473f None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc875dd0aa549dca8f19d0ce581bb84, group_id=7d7cec651f084d4f9b87c6edb7ef74e4, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:38.225213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ac723-8121-4fe4-91be-3e8be7ba473f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:38.229846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.249345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 197/389] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Sep 1 08:01:37 2022] PUT /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:38.258272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6adc74-d2a3-4d95-a0e3-8b56eb91fcbd None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.258272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6adc74-d2a3-4d95-a0e3-8b56eb91fcbd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.258272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6adc74-d2a3-4d95-a0e3-8b56eb91fcbd None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.258272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 198/390] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:38.265045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16f908-3e5c-45d9-8d81-813efb995a7f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.266023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16f908-3e5c-45d9-8d81-813efb995a7f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.266023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16f908-3e5c-45d9-8d81-813efb995a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.295307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634967de-8970-4c1c-a4e8-0ccaa70f567f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.310621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7a16f908-3e5c-45d9-8d81-813efb995a7f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:38.314060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7a16f908-3e5c-45d9-8d81-813efb995a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:38.416298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.417301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.417543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.422295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.422539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 199/391] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:38.435961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:38.442099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:38.443827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:38.445349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 193/392] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:01:38.451829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16f908-3e5c-45d9-8d81-813efb995a7f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.531609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.607172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16f908-3e5c-45d9-8d81-813efb995a7f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.660889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.661854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.661854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.662138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.662745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:38.663043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:38.664468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:38.678898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 200/393] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:38.685264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.755506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:38.901313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492fd86-f2e6-48bf-afa8-16908e7d3b79 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.949962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5dd4-5b65-4f46-b292-19549b48a9a9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:38.966438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.972575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:38.975358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:38.976417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:38.976904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:38.977363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:38.983414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:38.986472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:38.995386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 194/394] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:39.000449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.068343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.069458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.069948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.070482 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.112301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:39.138004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:39.139073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:39.139858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:39.144710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 201/395] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:01:39.153017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.327832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d3da-f659-4303-8081-e784778878d9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.414366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.415380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.415858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.416675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.419023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.420763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.423040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 195/396] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:38 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:39.431126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.439175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a3336-6cef-4ace-a951-4bf93b03c979 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.503995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.504636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.504915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.505187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.505871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:39.506179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.507633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.530610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 202/397] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:39.537496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.571037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:39.595714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:39.638128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fa860-14df-4027-a652-8c617701ea33 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.682472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11117990-ad1c-430d-87c4-d832ee3c85f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.683605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117990-ad1c-430d-87c4-d832ee3c85f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.683605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117990-ad1c-430d-87c4-d832ee3c85f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.683605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117990-ad1c-430d-87c4-d832ee3c85f0 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.685866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11117990-ad1c-430d-87c4-d832ee3c85f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e247570ef496410fa5831306e0872f1b, group_id=7d7cec651f084d4f9b87c6edb7ef74e4, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.687511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11117990-ad1c-430d-87c4-d832ee3c85f0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.702586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c969328-fe68-4d00-b11c-83d838191e08 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:39.720558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 196/398] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Sep 1 08:01:39 2022] PUT /identity/v3/projects/e247570ef496410fa5831306e0872f1b/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:39.720558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81fa0-b653-4d82-ac91-1398622c937b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.720558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81fa0-b653-4d82-ac91-1398622c937b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.720558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81fa0-b653-4d82-ac91-1398622c937b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.720558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 197/399] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:39.730321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe966fe-da0d-44c0-b852-ca5b888cba24 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.730763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe966fe-da0d-44c0-b852-ca5b888cba24 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.731134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe966fe-da0d-44c0-b852-ca5b888cba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.790261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0fe966fe-da0d-44c0-b852-ca5b888cba24 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:39.792278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0fe966fe-da0d-44c0-b852-ca5b888cba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:39.799555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:39.801446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.801952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.802456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.805239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:39.807231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:39.814344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 203/400] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:39 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:39.817170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:39.918587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 198/401] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:39.919908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a448df-9f9a-419a-816b-2a7c7253462b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.920192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a448df-9f9a-419a-816b-2a7c7253462b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.920462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a448df-9f9a-419a-816b-2a7c7253462b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.922793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 199/402] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:39.928443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41008-9cc7-43d2-8cfa-0f729281019c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:39.928722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41008-9cc7-43d2-8cfa-0f729281019c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:39.929000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd41008-9cc7-43d2-8cfa-0f729281019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:39.949889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bfd41008-9cc7-43d2-8cfa-0f729281019c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:39.951059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bfd41008-9cc7-43d2-8cfa-0f729281019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:39.954602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:39.959833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ce617-bfeb-4b8b-9f3d-030adb5d3adf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:40.004309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:40.004956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:40.005231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:40.005500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:40.007299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:40.008765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:40.011507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 204/403] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:39 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:40.016992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:40.025028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:40.059280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 200/404] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:40.158934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db673a-2d05-4fe4-8e88-6acdd0c1b4b8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:40.198047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:40.198765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:40.199043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:40.199325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:40.201671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fc875dd0aa549dca8f19d0ce581bb84, group_id=7d7cec651f084d4f9b87c6edb7ef74e4, role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:40.203080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:40.218850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 205/405] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Sep 1 08:01:40 2022] PUT /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:01:40.458566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd41008-9cc7-43d2-8cfa-0f729281019c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:40.592868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:40.627385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd41008-9cc7-43d2-8cfa-0f729281019c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:40.628893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:40.698649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:40.700256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:40.701041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:40.701802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:40.722377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:40.728957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5709f17-3ceb-4753-8c71-4ca4dd343ba1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:40.733827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:40.735904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:40.737536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:40.742481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 201/406] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:40.761886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:40.785017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:40.786006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:40.786308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:40.786585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:40.802466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:40.808707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:40.810427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:40.811923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:40.814377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 206/407] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:40.817561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:40.922258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:40.926902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:40.943937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753232f-1741-4754-a368-a8dc7de0bc4f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:40.985880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:40.986490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:40.986773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:40.987052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:40.989543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:40.989887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:40.991334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:41.006824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 207/408] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:41.009312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.109606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd40edc-0852-4988-943b-78a106ec995d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:41.136131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ea311-64cd-4bb8-99fd-19ab0d8c345f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:41.209302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:41.210537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.211342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.212000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.213498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:41.214339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:41.217436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:41.235779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 202/409] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:41.243438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.252552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:41.254992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.256189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.258565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.271817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:41.275144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:41.278518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 208/410] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:41.286164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.345285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:41.569788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d10b10-e7be-4420-a3bb-75fcc8a7d216 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:41.626624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca749fa-ce09-47df-8806-4b96ca2bc3cf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:41.646757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dab3e-4cbc-47ac-8531-479f056c7932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:41.647849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dab3e-4cbc-47ac-8531-479f056c7932 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.648359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dab3e-4cbc-47ac-8531-479f056c7932 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.648613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:41.648844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dab3e-4cbc-47ac-8531-479f056c7932 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.651421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dab3e-4cbc-47ac-8531-479f056c7932 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:41.654627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dab3e-4cbc-47ac-8531-479f056c7932 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:41.658616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 209/411] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:41.661830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc16c-0286-4dbe-97e9-0d5cdb8dd5c1 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.662522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc16c-0286-4dbe-97e9-0d5cdb8dd5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.663127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc16c-0286-4dbe-97e9-0d5cdb8dd5c1 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.666154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 210/412] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:41.667476 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc16c-0286-4dbe-97e9-0d5cdb8dd5c1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.696169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f493c-ca75-4f34-a221-cb656115c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:41.697214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f493c-ca75-4f34-a221-cb656115c74a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.697831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f493c-ca75-4f34-a221-cb656115c74a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.698344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f493c-ca75-4f34-a221-cb656115c74a None admin] PATH_INFO: `/v3/groups/3dd183ee1fcb48c1808c0db571c2e362` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.700310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f493c-ca75-4f34-a221-cb656115c74a None admin] RBAC: Authorizing `identity:get_group(group_id=3dd183ee1fcb48c1808c0db571c2e362)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:41.703248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f493c-ca75-4f34-a221-cb656115c74a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:41.707646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 203/413] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/groups/3dd183ee1fcb48c1808c0db571c2e362 => generated 229 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:41.709837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7a39-5e51-44ef-947b-0b1b02e38def None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.710345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7a39-5e51-44ef-947b-0b1b02e38def None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.710858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a7a39-5e51-44ef-947b-0b1b02e38def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.744971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c85a7a39-5e51-44ef-947b-0b1b02e38def None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:41.747024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c85a7a39-5e51-44ef-947b-0b1b02e38def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:41.833158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:41.854830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc16c-0286-4dbe-97e9-0d5cdb8dd5c1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:41.887723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 204/414] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:41.889821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a7a39-5e51-44ef-947b-0b1b02e38def None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:41.893541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:41.895185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:41.895636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:41.895911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:41.898383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] RBAC: Authorizing `identity:create_grant(project_id=e247570ef496410fa5831306e0872f1b, group_id=7d7cec651f084d4f9b87c6edb7ef74e4, role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:41.900122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:41.929047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 211/415] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Sep 1 08:01:41 2022] PUT /identity/v3/projects/e247570ef496410fa5831306e0872f1b/groups/7d7cec651f084d4f9b87c6edb7ef74e4/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:42.096608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a7a39-5e51-44ef-947b-0b1b02e38def None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.124081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.186444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.187450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.187925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.188392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] PATH_INFO: `/v3/projects/7901ef731efb4e4d9c32801133aae298` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.190471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] RBAC: Authorizing `identity:get_project(project_id=7901ef731efb4e4d9c32801133aae298)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.194163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.197794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 205/416] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:41 2022] GET /identity/v3/projects/7901ef731efb4e4d9c32801133aae298 => generated 344 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:42.204073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.361830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ef69-f520-4482-b3b8-c663de41025f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.388393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.411582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212930-36e0-4f56-9363-3861bd39685b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.412262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212930-36e0-4f56-9363-3861bd39685b None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.412543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212930-36e0-4f56-9363-3861bd39685b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.412819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212930-36e0-4f56-9363-3861bd39685b None admin] PATH_INFO: `/v3/projects/7901ef731efb4e4d9c32801133aae298/groups/3dd183ee1fcb48c1808c0db571c2e362/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.417430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af212930-36e0-4f56-9363-3861bd39685b None admin] RBAC: Authorizing `identity:create_grant(project_id=7901ef731efb4e4d9c32801133aae298, group_id=3dd183ee1fcb48c1808c0db571c2e362, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.424425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af212930-36e0-4f56-9363-3861bd39685b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.448207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 212/417] 10.222.0.36 () {58 vars in 1442 bytes} [Thu Sep 1 08:01:42 2022] PUT /identity/v3/projects/7901ef731efb4e4d9c32801133aae298/groups/3dd183ee1fcb48c1808c0db571c2e362/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:01:42.579149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadcb70-d8cd-4029-b55b-8837b83ede97 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.672920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.674453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.675559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.676072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.692899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:42.698541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:42.699501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:42.700286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:42.704306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 206/418] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:42.709873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c006a19-baf8-4133-bfeb-4d1f9ebddcb7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.709873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c006a19-baf8-4133-bfeb-4d1f9ebddcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.709873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c006a19-baf8-4133-bfeb-4d1f9ebddcb7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.710229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 213/419] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:42.711768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.717541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64fb14-56dc-43e2-bcd2-094f5571548a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.717975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64fb14-56dc-43e2-bcd2-094f5571548a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.718447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64fb14-56dc-43e2-bcd2-094f5571548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.740040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.766685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:42.769259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1e64fb14-56dc-43e2-bcd2-094f5571548a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:42.771487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1e64fb14-56dc-43e2-bcd2-094f5571548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:42.839681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ab9e9-60c1-4684-a6cf-c8b343450478 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:42.880017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:42.880657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:42.880944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:42.881220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:42.881922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:42.882225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:42.883664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:42.893385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 207/420] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:42.899238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:42.955832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 214/421] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:43.036019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:43.040593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d44f6b-f305-4007-a342-9455764de9b6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.082967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.083692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.083981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.084257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.167902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:43.169439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:43.290627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:43.297193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 208/422] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 08:01:43.303967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64fb14-56dc-43e2-bcd2-094f5571548a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:43.433386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:43.529071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64fb14-56dc-43e2-bcd2-094f5571548a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.618472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95049fbd-40e7-4f94-82f7-4b1c6c5faa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.619403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049fbd-40e7-4f94-82f7-4b1c6c5faa35 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.619828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049fbd-40e7-4f94-82f7-4b1c6c5faa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.620247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95049fbd-40e7-4f94-82f7-4b1c6c5faa35 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.621607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95049fbd-40e7-4f94-82f7-4b1c6c5faa35 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:43.623499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95049fbd-40e7-4f94-82f7-4b1c6c5faa35 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:43.631799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 215/423] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:43 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:43.632789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029292-3563-462b-9838-01647ada17cd None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.633258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029292-3563-462b-9838-01647ada17cd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.633746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029292-3563-462b-9838-01647ada17cd None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.637885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 216/424] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:43.638188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029292-3563-462b-9838-01647ada17cd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:43.649015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:43.682010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c87b1-8889-48e1-a123-634149cde55c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.723963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7c4ae-2fb7-429a-b3ba-1b77d7fb3fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.724963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c4ae-2fb7-429a-b3ba-1b77d7fb3fad None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.725471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c4ae-2fb7-429a-b3ba-1b77d7fb3fad None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.725971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7c4ae-2fb7-429a-b3ba-1b77d7fb3fad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.739383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7c4ae-2fb7-429a-b3ba-1b77d7fb3fad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-85a7c4ae-2fb7-429a-b3ba-1b77d7fb3fad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:43.745116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:43.746016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 08:01:43.746912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:43.749502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 209/425] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:43.752155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17814-0ccd-43a1-80d6-8029d6623405 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.757304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17814-0ccd-43a1-80d6-8029d6623405 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.758060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f17814-0ccd-43a1-80d6-8029d6623405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.780495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-78f17814-0ccd-43a1-80d6-8029d6623405 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:43.782594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-78f17814-0ccd-43a1-80d6-8029d6623405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:43.849365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:43.854187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e029292-3563-462b-9838-01647ada17cd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.866986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 210/426] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:43.868281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f17814-0ccd-43a1-80d6-8029d6623405 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:43.983619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:43.984325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:43.984559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:43.985099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:43.991108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:43.992020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f17814-0ccd-43a1-80d6-8029d6623405 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:43.992592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:43.998266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 217/427] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:43 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:44.016320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:44.043361 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:44.044361 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.044874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.045347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.046261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] RBAC: Adding query filter params (name=member) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:44.046790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:44.049058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:44.065529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 211/428] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:01:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:44.067932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:44.129524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:44.165753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:44.203724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337052f5-7c70-4a7f-9aa1-e26443b6988a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:44.208890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7962-c64e-464e-85ea-b69ce51f0bcc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:44.241445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:44.242065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.242394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.242658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.243655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:44.243804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:44.245157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:44.258275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 218/429] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=2d6361445523491fb757e0b12f225dcb => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:44.259217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:44.260102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.260535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.260946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.374566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:44.376377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:44.445779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:44.477831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:44.552131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 212/430] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:44.566183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:44.687553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406481eb-0171-46ef-9c5d-88507d6880d8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:44.742861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ee13-2238-493a-a865-c642679eb040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:44.743427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ee13-2238-493a-a865-c642679eb040 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.743709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ee13-2238-493a-a865-c642679eb040 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.743989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ee13-2238-493a-a865-c642679eb040 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.745842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ee13-2238-493a-a865-c642679eb040 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:44.747049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c990542-ff67-49a8-b912-d6e6f1b8809d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:44.747345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ee13-2238-493a-a865-c642679eb040 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:44.749350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 213/431] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:44.750917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44d50e-0bb8-4ffe-8ce1-afa1ec1ce380 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.750917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44d50e-0bb8-4ffe-8ce1-afa1ec1ce380 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.751218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44d50e-0bb8-4ffe-8ce1-afa1ec1ce380 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.752548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 214/432] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:44.758160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd86e5-d81c-4e21-a7e3-ad2ef3c194fb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.758506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd86e5-d81c-4e21-a7e3-ad2ef3c194fb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.758762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd86e5-d81c-4e21-a7e3-ad2ef3c194fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.788222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-67cd86e5-d81c-4e21-a7e3-ad2ef3c194fb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:44.789760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-67cd86e5-d81c-4e21-a7e3-ad2ef3c194fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:44.797006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:44.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:44.797939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:44.798206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:44.802925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:44.807840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:44.818864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:44.829958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:44.830941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:44.832734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:44.838437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 219/433] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:44.839916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:44.900218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 215/434] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:44.902141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd86e5-d81c-4e21-a7e3-ad2ef3c194fb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.049188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd86e5-d81c-4e21-a7e3-ad2ef3c194fb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.069281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555c06b-8009-4bbe-828e-3b0e25fca3ba None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.094778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82870678-55fe-4f56-b5a5-5222dea8a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.095666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870678-55fe-4f56-b5a5-5222dea8a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.095934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870678-55fe-4f56-b5a5-5222dea8a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.096207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82870678-55fe-4f56-b5a5-5222dea8a9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.096968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870678-55fe-4f56-b5a5-5222dea8a9d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:45.097509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870678-55fe-4f56-b5a5-5222dea8a9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:45.098994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82870678-55fe-4f56-b5a5-5222dea8a9d7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:45.109535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa7edf-daa3-43df-a7d2-36bda5b1b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.111105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7edf-daa3-43df-a7d2-36bda5b1b23c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.111105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7edf-daa3-43df-a7d2-36bda5b1b23c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.111105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa7edf-daa3-43df-a7d2-36bda5b1b23c None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.112339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa7edf-daa3-43df-a7d2-36bda5b1b23c None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:45.113827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa7edf-daa3-43df-a7d2-36bda5b1b23c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:45.115760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 220/435] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:45.117047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a5245-18b1-494c-a3b8-772a43b4fbb0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.117329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a5245-18b1-494c-a3b8-772a43b4fbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.117601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a5245-18b1-494c-a3b8-772a43b4fbb0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.119106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 216/437] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:45.119270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 221/437] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:45.124010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a5245-18b1-494c-a3b8-772a43b4fbb0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.127064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145da9ac-284e-45f9-b537-3a3580e893d8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.127554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145da9ac-284e-45f9-b537-3a3580e893d8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.128731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145da9ac-284e-45f9-b537-3a3580e893d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.164243 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-145da9ac-284e-45f9-b537-3a3580e893d8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:45.166285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-145da9ac-284e-45f9-b537-3a3580e893d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:45.171383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:45.209133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:45.260746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a5245-18b1-494c-a3b8-772a43b4fbb0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.273444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 217/438] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:45.274338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145da9ac-284e-45f9-b537-3a3580e893d8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.306777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.307275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.307554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.307829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.308558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=2d6361445523491fb757e0b12f225dcb, scope.project.id=e247570ef496410fa5831306e0872f1b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:45.308892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:45.310565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:45.317916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 222/439] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=2d6361445523491fb757e0b12f225dcb => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:45.327375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.449936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145da9ac-284e-45f9-b537-3a3580e893d8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.478399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d07b23-84e6-44c4-821f-4fe9be159d60 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.511393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:45.523319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.524214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.524402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.524836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.524935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.525126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.525315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.525410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.543108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:45.552543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:45.553923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:45.554810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:45.555663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:45.556951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 223/440] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:45.563850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.653037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:45.655944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:45.715230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925747c2-a9ca-4af4-a642-b2f5ecc9e52d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.756575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.757219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.757487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.757752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.758458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:45.758751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:45.760140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:45.769230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 224/441] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:45.771028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.818853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 218/442] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:45.820613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.849371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:45.875693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:45.905215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68ec2c-af66-41d0-9971-89f227551c54 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.943293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.944219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.944617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.945098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:45.950650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b485e-6312-4629-93e6-500ea8c98695 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:45.957464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:45.962865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:45.963762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:45.964518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 225/443] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:45.965148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:45.995672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:45.996621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:45.997079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:45.997525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.083000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.085378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.090838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f488e-9318-4b68-88ba-f96d233cf93f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.101599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.129604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.130264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.130547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.130822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] PATH_INFO: `/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.132012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=0fc875dd0aa549dca8f19d0ce581bb84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.132147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.133653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.135384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 226/444] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/projects/0fc875dd0aa549dca8f19d0ce581bb84 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.136184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.200271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 219/445] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:46.201144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.255970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4ed9a-1020-4ad7-8a26-02943523b4a1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.305491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.306123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.306450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.306724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.307427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:46.307739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.309225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.317843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62934e-0d52-421a-9644-d9de9d75a69b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.320191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 227/446] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.321164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.375982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.380127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.380800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.381087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.381369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.382684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.384209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.385916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 220/447] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.386790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.399769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.463195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20208a-1a83-4d36-850e-c113b2178f10 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.516946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.517744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.518112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.519035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] PATH_INFO: `/v3/projects/e247570ef496410fa5831306e0872f1b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.521011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e247570ef496410fa5831306e0872f1b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.522914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.525108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 228/448] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/projects/e247570ef496410fa5831306e0872f1b => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.526218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.529262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bfcd37-744e-4a55-8b22-d9c9779a4738 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.575208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.575829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.576108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.576381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.662370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7e263-72f1-4649-8be0-ea8556d5c0d8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.670317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.676684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.678296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.691645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:46.705723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.707231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.707514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.707785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.708529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:46.708837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.710354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.717061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 229/449] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=0fc875dd0aa549dca8f19d0ce581bb84&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.717712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.884987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 221/450] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:46.891852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:46.896456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558e1cb-80d4-4f10-800c-dec8ad772489 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:46.961902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:46.961902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:46.961902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:46.961902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] PATH_INFO: `/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:46.962935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] RBAC: Authorizing `identity:get_group(group_id=7d7cec651f084d4f9b87c6edb7ef74e4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:46.964634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:46.967433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 230/451] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/groups/7d7cec651f084d4f9b87c6edb7ef74e4 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:46.977075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:47.054157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:47.058057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6544-0b59-4cdb-a467-8bf0a5ccbba0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:47.074695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:47.122481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:47.123617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:47.124066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:47.124495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] PATH_INFO: `/v3/projects/7901ef731efb4e4d9c32801133aae298` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:47.126490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] RBAC: Authorizing `identity:get_project(project_id=7901ef731efb4e4d9c32801133aae298)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:47.129855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:47.133084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 222/452] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/projects/7901ef731efb4e4d9c32801133aae298 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:47.141393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:47.176513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94ffa9-3e63-4ffd-bf69-a12feca8dc38 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:47.249816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:47.251283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:47.251767 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:47.252236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:47.254227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] RBAC: Adding query filter params (group.id=7d7cec651f084d4f9b87c6edb7ef74e4, role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=e247570ef496410fa5831306e0872f1b) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:47.254805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:47.257625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:47.276002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 231/453] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:46 2022] GET /identity/v3/role_assignments?group.id=7d7cec651f084d4f9b87c6edb7ef74e4&scope.project.id=e247570ef496410fa5831306e0872f1b&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 611 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:47.336404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c960e3b-a502-4bba-b218-660c8eef1d07 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:47.408664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548996f2-a512-4143-941a-ad00c8ce317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:47.410679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548996f2-a512-4143-941a-ad00c8ce317f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:47.411070 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548996f2-a512-4143-941a-ad00c8ce317f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:47.411517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548996f2-a512-4143-941a-ad00c8ce317f None admin] PATH_INFO: `/v3/groups/3dd183ee1fcb48c1808c0db571c2e362` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:47.414343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548996f2-a512-4143-941a-ad00c8ce317f None admin] RBAC: Authorizing `identity:get_group(group_id=3dd183ee1fcb48c1808c0db571c2e362)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:47.417175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548996f2-a512-4143-941a-ad00c8ce317f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:47.420812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 223/454] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Sep 1 08:01:47 2022] GET /identity/v3/groups/3dd183ee1fcb48c1808c0db571c2e362 => generated 229 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:01:47.430953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:47.585145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772d5e1-df06-4b21-ab9c-56d5d620e4da None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:47.586998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:47.642498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9eabd-c2d7-42dd-a7db-d2c673af02df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:47.644075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9eabd-c2d7-42dd-a7db-d2c673af02df None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:47.644554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9eabd-c2d7-42dd-a7db-d2c673af02df None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:47.645049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9eabd-c2d7-42dd-a7db-d2c673af02df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:47.646395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9eabd-c2d7-42dd-a7db-d2c673af02df None admin] RBAC: Adding query filter params (group.id=3dd183ee1fcb48c1808c0db571c2e362, role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=7901ef731efb4e4d9c32801133aae298) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:47.646940 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9eabd-c2d7-42dd-a7db-d2c673af02df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:47.649554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9eabd-c2d7-42dd-a7db-d2c673af02df None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:47.660638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 232/455] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Sep 1 08:01:47 2022] GET /identity/v3/role_assignments?group.id=3dd183ee1fcb48c1808c0db571c2e362&scope.project.id=7901ef731efb4e4d9c32801133aae298&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 611 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:50.080358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf25bb-1ce3-494d-a1ac-6b911bf90e4f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:50.082162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf25bb-1ce3-494d-a1ac-6b911bf90e4f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:50.082881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf25bb-1ce3-494d-a1ac-6b911bf90e4f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:50.085765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 224/456] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:50.092094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb4ce5-0c2f-47e8-b5f3-33abfea709b2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:50.092818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb4ce5-0c2f-47e8-b5f3-33abfea709b2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:50.092818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb4ce5-0c2f-47e8-b5f3-33abfea709b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:50.120400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e8bb4ce5-0c2f-47e8-b5f3-33abfea709b2 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:50.121662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e8bb4ce5-0c2f-47e8-b5f3-33abfea709b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:50.221419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 233/457] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:50.695729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf25bb-1ce3-494d-a1ac-6b911bf90e4f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:50.771195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:50.913180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf25bb-1ce3-494d-a1ac-6b911bf90e4f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:50.995994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4fbdb-d4b9-4e1d-bec0-f9667b7c4140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:50.997074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fbdb-d4b9-4e1d-bec0-f9667b7c4140 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:50.997563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fbdb-d4b9-4e1d-bec0-f9667b7c4140 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:50.998056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4fbdb-d4b9-4e1d-bec0-f9667b7c4140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.026428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4fbdb-d4b9-4e1d-bec0-f9667b7c4140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:51.029226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4fbdb-d4b9-4e1d-bec0-f9667b7c4140 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9fa4fbdb-d4b9-4e1d-bec0-f9667b7c4140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:51.066770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:51.067755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:51.068582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:51.068582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:51.068582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:51.074945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 225/458] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:51.081541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb4ce5-0c2f-47e8-b5f3-33abfea709b2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:51.147302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf58d-8d1c-453b-9a1e-8b7fe4602124 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.147818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf58d-8d1c-453b-9a1e-8b7fe4602124 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.148259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbf58d-8d1c-453b-9a1e-8b7fe4602124 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.150760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 226/459] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:51.156946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851cf74-a360-48f4-a173-6079862702a3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.157831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851cf74-a360-48f4-a173-6079862702a3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.158604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851cf74-a360-48f4-a173-6079862702a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.222963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a851cf74-a360-48f4-a173-6079862702a3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:51.224116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a851cf74-a360-48f4-a173-6079862702a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:51.271907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb4ce5-0c2f-47e8-b5f3-33abfea709b2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:51.275834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:51.312672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:51.313549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.313978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.314600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.315855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:51.316322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:51.318129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:51.342363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 234/460] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:51.346189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:51.371289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 227/461] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:51.523942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51297e32-cbcd-4823-baa5-eba0a3951f3d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:51.563719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c199a-6e23-4f34-8894-881eb48ed191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:51.564595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c199a-6e23-4f34-8894-881eb48ed191 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.565045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c199a-6e23-4f34-8894-881eb48ed191 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.565492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c199a-6e23-4f34-8894-881eb48ed191 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.566348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c199a-6e23-4f34-8894-881eb48ed191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:51.569106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c199a-6e23-4f34-8894-881eb48ed191 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:51.620787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 235/462] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:51 2022] POST /identity/v3/users => generated 246 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:01:51.825151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7f6d-e7a2-4045-b86f-f7dbc551af5b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.825366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7f6d-e7a2-4045-b86f-f7dbc551af5b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.825728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7f6d-e7a2-4045-b86f-f7dbc551af5b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.827399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 228/463] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:51.831222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cdf78-6581-4873-a316-a262bc4cb7bb None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.831577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cdf78-6581-4873-a316-a262bc4cb7bb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.831809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cdf78-6581-4873-a316-a262bc4cb7bb None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.833168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 236/464] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:51.839365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e437f-1f43-451f-b09e-49e85a9bd29e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.839841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e437f-1f43-451f-b09e-49e85a9bd29e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.840293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e437f-1f43-451f-b09e-49e85a9bd29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.847253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f181-d41d-449f-b36f-5bbc25f98ba1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:51.847664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f181-d41d-449f-b36f-5bbc25f98ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:51.848069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f181-d41d-449f-b36f-5bbc25f98ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:51.895258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f80e437f-1f43-451f-b09e-49e85a9bd29e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:51.897159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f80e437f-1f43-451f-b09e-49e85a9bd29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:51.909693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2970f181-d41d-449f-b36f-5bbc25f98ba1 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:51.912534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2970f181-d41d-449f-b36f-5bbc25f98ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:51.928086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:51.938046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.012766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 229/465] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:52.013678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e437f-1f43-451f-b09e-49e85a9bd29e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.050232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 237/466] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:52.137839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e437f-1f43-451f-b09e-49e85a9bd29e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.183555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.184657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.185156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.185641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.213163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.215849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:52.254692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:52.255645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:52.256469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:52.256469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:52.256469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:52.261931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 230/467] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:52.266316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f181-d41d-449f-b36f-5bbc25f98ba1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.376960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.409540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.442590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f181-d41d-449f-b36f-5bbc25f98ba1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.488211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.489129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.489554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.489966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.490802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:52.491253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.492678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.507204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 238/468] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:52.508079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.514081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.558565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1799ffc-e1d8-4a94-8cf6-34cdd006a398 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.607560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad985ca-fe16-42c4-a0c9-4b7b3d57ebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.608812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad985ca-fe16-42c4-a0c9-4b7b3d57ebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.608925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad985ca-fe16-42c4-a0c9-4b7b3d57ebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.609169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad985ca-fe16-42c4-a0c9-4b7b3d57ebb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.627925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad985ca-fe16-42c4-a0c9-4b7b3d57ebb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.629480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad985ca-fe16-42c4-a0c9-4b7b3d57ebb0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1ad985ca-fe16-42c4-a0c9-4b7b3d57ebb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:52.645976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:52.647810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:52.648948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:52.648948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:52.648948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:52.652440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 231/469] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:52.653356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4017c-e99a-490e-bac4-57b8be67bbd4 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.653643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4017c-e99a-490e-bac4-57b8be67bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.653919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4017c-e99a-490e-bac4-57b8be67bbd4 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.655868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 232/470] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:52.659816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4017c-e99a-490e-bac4-57b8be67bbd4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.664969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684b28c-97eb-48ea-b398-2908796be403 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.714615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.715346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.715855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.716346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.734947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.736445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:52.752525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:52.755647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:52.757909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:52.757909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:52.757909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:52.757909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 239/471] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:52.757909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:52.760852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.830582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4017c-e99a-490e-bac4-57b8be67bbd4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.836321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:52.881968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf509c3-4063-4cf7-bd33-c8b07bcd958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.883052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf509c3-4063-4cf7-bd33-c8b07bcd958d None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.883550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf509c3-4063-4cf7-bd33-c8b07bcd958d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.884047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf509c3-4063-4cf7-bd33-c8b07bcd958d None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.885304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf509c3-4063-4cf7-bd33-c8b07bcd958d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.887963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf509c3-4063-4cf7-bd33-c8b07bcd958d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.898480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a12e8c-5d8a-49cc-baf5-b66a1113a4bb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:52.917596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 233/472] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:52 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:52.918937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b843f4-415a-4aa6-8a99-32bc280af688 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.919296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b843f4-415a-4aa6-8a99-32bc280af688 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.919643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b843f4-415a-4aa6-8a99-32bc280af688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.942045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-42b843f4-415a-4aa6-8a99-32bc280af688 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:52.943863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-42b843f4-415a-4aa6-8a99-32bc280af688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:52.949077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:52.949836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:52.950303 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:52.950652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:52.951401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:52.951775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:52.953426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:52.974522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 240/473] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:52.974522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.046284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 234/474] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:53.046284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b843f4-415a-4aa6-8a99-32bc280af688 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.100868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.207854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad68c0-a5f9-4dc1-8a2f-b53bdff82b5b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.214519 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b843f4-415a-4aa6-8a99-32bc280af688 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.240360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.279692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.281385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.282146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.282964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.285385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:53.286541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.288694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.289137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.289696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.290080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.290463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.291257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.293709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.316654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 241/475] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:53.328898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.338363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 235/476] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:53 2022] POST /identity/v3/users => generated 248 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:53.405376 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.554263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ac04a-8c73-4a19-b62e-ceda10b26bab None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.620388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.621035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.621319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.621594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.623466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.626284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.659629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c877e-8744-4e07-b5c3-16a03dbcee13 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:53.662951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.665674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 242/477] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:53 2022] POST /identity/v3/users => generated 249 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:01:53.716291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:53.717016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:53.717307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:53.717587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:53.718384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:53.719960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:53.730780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.sql.core [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 08:01:53.730780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 08:01:53.730780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [parameters: {'id': '4b8ab21b53254c7ea5bef8995d9c152e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 08:01:53.730780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81642) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Sep 01 08:01:53.750329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:01:53.751905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application yield resource Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise self.value Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application session.commit() Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 08:01:53.755769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.session.flush() Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application compat.raise_( Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 08:01:53.758937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:01:53.761932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application result.read() Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:01:53.763671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [parameters: {'id': '4b8ab21b53254c7ea5bef8995d9c152e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:53.765339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 08:01:53.767067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:53.773706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 236/478] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Sep 1 08:01:53 2022] POST /identity/v3/roles => generated 144 bytes in 348 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:53.774001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:53.829398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:53.974885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b29614-8fa1-43d3-b177-66421b4195ae None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.040467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc7946-9eb9-4125-99f2-87e1eb841f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.041922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7946-9eb9-4125-99f2-87e1eb841f41 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.042658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7946-9eb9-4125-99f2-87e1eb841f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.043418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc7946-9eb9-4125-99f2-87e1eb841f41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.063481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc7946-9eb9-4125-99f2-87e1eb841f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-89fc7946-9eb9-4125-99f2-87e1eb841f41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:54.076700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 08:01:54.078437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:54.082897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 243/479] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:01:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:54.091773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.239795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93ffc-21ab-4ad6-a140-ab32607475de None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.240084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93ffc-21ab-4ad6-a140-ab32607475de None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.240363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93ffc-21ab-4ad6-a140-ab32607475de None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.242026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 244/480] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:54.245104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7de9-3dc9-4e5b-b318-c4b1c67256c4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:54.248844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe0228-67b5-4e0e-9c1e-b6c6b4b98a46 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.249128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe0228-67b5-4e0e-9c1e-b6c6b4b98a46 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.249398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe0228-67b5-4e0e-9c1e-b6c6b4b98a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.291575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7ffe0228-67b5-4e0e-9c1e-b6c6b4b98a46 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:54.292939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7ffe0228-67b5-4e0e-9c1e-b6c6b4b98a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:54.296222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:54.297595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:54.298380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:54.299091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:54.300527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:54.301298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:54.303113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:54.320649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 237/481] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:54.430401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 245/482] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:54.809296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:54.851986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:54.977569 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67ff21-5097-4a36-ad09-f391eb9dd464 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.032927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.033587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.033903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.034215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.059590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:55.065706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:55.066785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:55.067563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 238/483] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:01:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:55.075435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe0228-67b5-4e0e-9c1e-b6c6b4b98a46 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.118125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:55.228173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe0228-67b5-4e0e-9c1e-b6c6b4b98a46 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.297743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.298803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.299287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.300299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.301228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:55.301734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.303462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.313693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 246/484] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:55.319556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.449041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:55.467879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1168fd8-1e65-443f-bc92-7907af03a701 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.516436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033fbd7-97c1-4bd8-afcb-38789c9ff8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.517082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fbd7-97c1-4bd8-afcb-38789c9ff8af None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.517360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fbd7-97c1-4bd8-afcb-38789c9ff8af None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.517632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fbd7-97c1-4bd8-afcb-38789c9ff8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.539442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033fbd7-97c1-4bd8-afcb-38789c9ff8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.540959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033fbd7-97c1-4bd8-afcb-38789c9ff8af None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e033fbd7-97c1-4bd8-afcb-38789c9ff8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:55.557728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:55.558714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:55.559539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:55.559539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:55.559539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:55.563221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 239/485] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:55.570129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.734655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:55.761258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869751b-9cf8-4e78-bde4-fba57bbebe18 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:55.795186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e5c45-9d6b-4590-94b7-502e0695f522 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.795554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e5c45-9d6b-4590-94b7-502e0695f522 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.795752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e5c45-9d6b-4590-94b7-502e0695f522 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.797177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 240/486] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:55.808636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:55.809268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.809556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.809830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.810527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:55.810829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:55.812272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:55.817893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2548-571e-47b3-8847-062fef25994e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:55.818208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2548-571e-47b3-8847-062fef25994e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:55.818500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc2548-571e-47b3-8847-062fef25994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:55.833262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 247/487] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:55.839029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:55.863136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-17cc2548-571e-47b3-8847-062fef25994e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:55.864359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-17cc2548-571e-47b3-8847-062fef25994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:56.012479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 241/488] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:01:56.034450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d50c9-5bd9-415e-a60a-19aa7576bcbd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:56.092112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:56.092731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.093027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.093305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.105085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:56.106585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:01:56.126513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:56.128166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:56.129099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 248/489] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:01:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:01:56.135978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc2548-571e-47b3-8847-062fef25994e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:56.254167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:56.296136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc2548-571e-47b3-8847-062fef25994e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:56.319967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:56.326597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:56.339916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0e5bd-4d54-42a4-8b32-60d4b4038f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:56.340616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e5bd-4d54-42a4-8b32-60d4b4038f39 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.340807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e5bd-4d54-42a4-8b32-60d4b4038f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.341081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0e5bd-4d54-42a4-8b32-60d4b4038f39 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.341840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0e5bd-4d54-42a4-8b32-60d4b4038f39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:56.342201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0e5bd-4d54-42a4-8b32-60d4b4038f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:56.343694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0e5bd-4d54-42a4-8b32-60d4b4038f39 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:56.388848 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 242/490] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:01:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:56.390754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efda9e-6f92-4793-9402-857ce7731ca3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.391154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efda9e-6f92-4793-9402-857ce7731ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.391438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efda9e-6f92-4793-9402-857ce7731ca3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.393163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 243/491] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:56.399936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efda9e-6f92-4793-9402-857ce7731ca3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:56.516040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1634457-b7ea-409a-8e67-bf209a1104cb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:56.574913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3718e3-55ed-458c-8db6-6531c408fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:56.575666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3718e3-55ed-458c-8db6-6531c408fca8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.576019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3718e3-55ed-458c-8db6-6531c408fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.576366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3718e3-55ed-458c-8db6-6531c408fca8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.602025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efda9e-6f92-4793-9402-857ce7731ca3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:56.604341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3718e3-55ed-458c-8db6-6531c408fca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4b3718e3-55ed-458c-8db6-6531c408fca8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:56.615647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:56.616621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:56.617405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:56.618102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 249/492] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:01:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:56.620947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0b88-676c-41bc-8c05-1abec3bbcde5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.621523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0b88-676c-41bc-8c05-1abec3bbcde5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.622079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0b88-676c-41bc-8c05-1abec3bbcde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.641681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:56.651642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2d1f0b88-676c-41bc-8c05-1abec3bbcde5 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:56.652868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2d1f0b88-676c-41bc-8c05-1abec3bbcde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:56.654675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4313637-ec41-4b93-ae8c-24135f2bea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:56.655719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313637-ec41-4b93-ae8c-24135f2bea54 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.656201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313637-ec41-4b93-ae8c-24135f2bea54 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.656674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4313637-ec41-4b93-ae8c-24135f2bea54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.723057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:56.746275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 250/493] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:56.746275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0b88-676c-41bc-8c05-1abec3bbcde5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:56.803032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4313637-ec41-4b93-ae8c-24135f2bea54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:56.807064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4313637-ec41-4b93-ae8c-24135f2bea54 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:56.921973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0b88-676c-41bc-8c05-1abec3bbcde5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:56.991707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47defdd-2ac9-44e1-bbba-6ba35281919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:56.992706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47defdd-2ac9-44e1-bbba-6ba35281919c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:56.993233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47defdd-2ac9-44e1-bbba-6ba35281919c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:56.993700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47defdd-2ac9-44e1-bbba-6ba35281919c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:56.995271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47defdd-2ac9-44e1-bbba-6ba35281919c None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:56.995452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47defdd-2ac9-44e1-bbba-6ba35281919c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:56.997801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47defdd-2ac9-44e1-bbba-6ba35281919c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:57.013831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 251/494] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:01:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:57.016027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ea55d-fa6b-4917-8fff-8c0fd52b0108 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.016507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ea55d-fa6b-4917-8fff-8c0fd52b0108 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.016973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ea55d-fa6b-4917-8fff-8c0fd52b0108 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.020229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 252/495] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:57.021498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ea55d-fa6b-4917-8fff-8c0fd52b0108 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.037360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 244/496] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:57.040018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb2e8-a12a-410f-81fd-2df3aa059c77 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.040828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb2e8-a12a-410f-81fd-2df3aa059c77 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.041579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fb2e8-a12a-410f-81fd-2df3aa059c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.064863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-551fb2e8-a12a-410f-81fd-2df3aa059c77 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:57.067029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-551fb2e8-a12a-410f-81fd-2df3aa059c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:57.098183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:57.111172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:57.170518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 245/497] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:57.170518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fb2e8-a12a-410f-81fd-2df3aa059c77 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.180735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ea55d-fa6b-4917-8fff-8c0fd52b0108 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.222553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.224132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.224580 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.225069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.238622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:57.240435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:57.261613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:57.262815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:57.263863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:57.263863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:57.263863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:57.265705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 253/498] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:57.266746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.354424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fb2e8-a12a-410f-81fd-2df3aa059c77 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.383550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84cf7b-8968-4604-ad4f-830cf73f1150 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.391264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:57.412822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e664e38-c044-4f07-adbd-0184f2ef6e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.413862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664e38-c044-4f07-adbd-0184f2ef6e3e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.414377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664e38-c044-4f07-adbd-0184f2ef6e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.414849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664e38-c044-4f07-adbd-0184f2ef6e3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.423401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.424045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.425090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.425580 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.433101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e664e38-c044-4f07-adbd-0184f2ef6e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:57.437035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:57.438786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8e664e38-c044-4f07-adbd-0184f2ef6e3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:57.443263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:57.444351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:57.445346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:57.452587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 246/499] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:57.454602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860eb0a-95e3-4f28-89f7-8c858434dbb2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.455096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860eb0a-95e3-4f28-89f7-8c858434dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.456113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860eb0a-95e3-4f28-89f7-8c858434dbb2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.458536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 247/500] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:01:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:01:57.459850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860eb0a-95e3-4f28-89f7-8c858434dbb2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:57.460182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:57.461040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:57.461848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:57.461848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:57.461848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:57.463691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 254/501] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:57.464689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.488799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:57.616829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860eb0a-95e3-4f28-89f7-8c858434dbb2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.621952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47234498-59f7-44e9-a904-455f31c6df22 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.657198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.657801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.658083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.658410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.659715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:57.660018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:57.661185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f6401-ad33-4068-b6df-4361e9c08550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.661399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:57.661794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6401-ad33-4068-b6df-4361e9c08550 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.662070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6401-ad33-4068-b6df-4361e9c08550 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.662372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f6401-ad33-4068-b6df-4361e9c08550 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.663031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f6401-ad33-4068-b6df-4361e9c08550 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:57.663327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f6401-ad33-4068-b6df-4361e9c08550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:57.664678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f6401-ad33-4068-b6df-4361e9c08550 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:57.672935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 255/502] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:57.674156 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352af59-bf6a-4ac7-96ba-af0c531fe282 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.675051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352af59-bf6a-4ac7-96ba-af0c531fe282 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.675324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352af59-bf6a-4ac7-96ba-af0c531fe282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.675688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 248/503] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:57.677527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.694466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9352af59-bf6a-4ac7-96ba-af0c531fe282 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:01:57.695597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9352af59-bf6a-4ac7-96ba-af0c531fe282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:01:57.710934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:57.769771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:57.770862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 256/504] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:01:57.771846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352af59-bf6a-4ac7-96ba-af0c531fe282 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.802833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e53deb-ef1d-4bcd-971c-744165343fbc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.861369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.863399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.864141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.864714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:57.865743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:57.866051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:57.868460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:57.887944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 249/505] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:57.889606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:57.934325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352af59-bf6a-4ac7-96ba-af0c531fe282 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:57.989042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:57.989588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:57.990001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:57.990152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.002865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:01:58.008274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:58.011096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 257/506] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:58.012649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.037606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.072311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c63fc8-70d1-4e57-b06f-4682efbf0842 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.123473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.124116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.124379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.124653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.133133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.134637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.136705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:01:58.156377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:58.157551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:58.158633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 250/507] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:58.160135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.184656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206951f9-3ca7-49ac-ac2c-1e6db8ad7dc5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.228149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.229133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.229578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.230031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.249901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.252682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:58.277964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:58.279769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:58.280693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:58.280693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:58.280693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:58.280693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 258/508] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:58.281059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.313657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c4517-8f75-4d01-90c0-c29a26037d4e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.361482 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.365182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.365984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.366208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.366600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.374920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.376581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:01:58.391633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:58.394326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 251/509] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:58.395992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.422023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043ae90-7d99-41e8-9d9a-f294ac4bdf14 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.469063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.469888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.470331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.470724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.472438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:58.472878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.474480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.478794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.485595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 259/510] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:58.487570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.539730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1b96-79db-4e5c-9ada-94c6a4ac0e2a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.590204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.591287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.591764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.592319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.611341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.614542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:58.638849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:58.640068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:58.641119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:58.641119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:58.641119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:58.641119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 252/511] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:58.642102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.645347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e96103-6b58-4e54-9791-f8e45fbe7315 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.677133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.694126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.694996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.695379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.695736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.696672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:58.697084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.698731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.741670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 260/512] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:58.741670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.773977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417751f-146b-4c03-919c-0b0e987335d3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.785772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:58.827274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870c575-209e-428b-834f-2de757916b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.828206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870c575-209e-428b-834f-2de757916b3d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.828705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870c575-209e-428b-834f-2de757916b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.829181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870c575-209e-428b-834f-2de757916b3d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.830398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870c575-209e-428b-834f-2de757916b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:58.831502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870c575-209e-428b-834f-2de757916b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.834125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870c575-209e-428b-834f-2de757916b3d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.854044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 253/513] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:58.854979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870c575-209e-428b-834f-2de757916b3d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.867849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e82a3-781c-45fd-b006-8b25a9a94ac8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:58.913107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:58.914137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:58.914661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:58.915160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:58.916500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:58.917050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:58.919925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:58.954284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 261/514] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:58.955822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:58.978212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870c575-209e-428b-834f-2de757916b3d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.018481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.019359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.019795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.020117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.024037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.033218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.035146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:01:59.058103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:59.059959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:01:59.061064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:01:59.061064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:01:59.061064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:01:59.062435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 254/515] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:59.063830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.101257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.111106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9b937-905f-464e-8958-8b935b074790 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.154858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.155726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.156093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.156453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.157306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:59.157827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.160338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.175844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 262/516] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:59.177512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.204297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc76af4-7756-408c-8d95-bc3496ffb7c1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.267807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.269476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.269965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.270500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.293523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c164201-116a-40ac-89a7-8e42fb327f88 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.295272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.333569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.334208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.334523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.334794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.342785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.344289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:01:59.357792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:01:59.358782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:01:59.359911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 263/517] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:01:59.360691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.393694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.396659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.436258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.475024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a890fc-be75-49a4-b37e-7db6dc65127d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.523782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.524501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.524857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.525232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.526167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=3a545f5fde0d432fbe31819eb5c7c39d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:59.526578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.528145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.535010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 264/518] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/role_assignments?user.id=3a545f5fde0d432fbe31819eb5c7c39d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:59.535765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.566371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 255/519] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:01:59.568482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.581692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.726954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141f734-9e47-4693-b56a-8459c31bba90 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.747239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae11d3-35f4-4d58-bce8-430a70e8f344 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:01:59.776672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:01:59.790266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.791352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.791845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.792344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.793324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:01:59.793609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:01:59.793932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:01:59.794087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.794227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:01:59.794586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:01:59.795135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:01:59.796584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.796844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:01:59.824150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 256/520] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:01:59 2022] POST /identity/v3/users => generated 247 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:01:59.824676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 265/521] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:01:59.835424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:01:59.836049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.013225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.039927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bc283-9502-4627-b56a-1cf2de6e35dc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.040622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88004f40-3ced-40d7-b5d0-3ef4f8f2c0cd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.087291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.087926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.088206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.088482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.089248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:00.089555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.091063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.095672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.096483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.096760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.097171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.116120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 257/522] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:00.116988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.127239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.129740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:00.157426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:00.159518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:00.161449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:00.161449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:00.161449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:00.161449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 266/523] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:01:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:00.161449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.199855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.324583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560fa76-63d2-4441-b8c0-5aeabf1a97c2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.344504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48222de-6a74-43a6-9220-69dfb3511224 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.385788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.387081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.387549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.387998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.402848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.407720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.410742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.411644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.412199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.426395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.429285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:00.455117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:00.456816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:00.457887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:00.462776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 258/524] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:00.464291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.499138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.502745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.662963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.680183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff329a13-54a4-415a-bc9a-a864974fbf06 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.693372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 267/525] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:00.695318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.738744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.742087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.742087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.742087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.742087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:00.742087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.743556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.770656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 259/526] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:00.771694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.781418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:00.879358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186056f6-485b-48e7-81b0-7c69aea0246e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.911478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e79bd-271d-4eb7-8c8c-9ea0a30de75a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:00.944665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.945672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.946158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.946689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.947689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:00.948221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.949925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.955713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:00.956630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:00.957024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:00.957271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:00.973027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:00.973638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 268/527] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:00.974567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:00.975070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:00.996413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:00.998297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:01.000009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:01.000009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:01.000009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:01.000009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 260/528] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:01.000009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.014113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.122889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.135303 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86919f4-5858-4bc1-b7af-6fbe2d31c2a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.154832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bf1de-dcf1-4160-a6f1-01125d4b4a96 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.192224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.193250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.193604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.193937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.203742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.205328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.206600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.208050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.208847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.209583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:01.222503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:01.223515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:01.224344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 269/529] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:01.225001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.333440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.336911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.360607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.377157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c91d5-bdcc-4247-8776-815fe7709b2d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.431438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.431977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.432257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.432530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.433492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:01.433801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.436037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.452099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 270/530] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.456241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.479735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.499593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 261/531] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:01.500821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.601682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551caf4-a4a9-402d-99b0-cb601c109599 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.621641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeef233-f181-4227-8253-f1a289101ff8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.632725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.648380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.649422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.649924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.650432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.651350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:01.651867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.653637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.660842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.661481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.661757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.662024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.669777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.671133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 271/532] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.672212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.676486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:01.689407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:01.691247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:01.692125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 262/533] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:01.693031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.778199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:01.806352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999339b7-d5c8-4d1d-891b-e0e78d78e6e6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.828900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93757d18-ea6e-4903-ad41-8d7bdcc946b3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:01.858887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.859844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.860123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.860397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.881193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.882946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.883467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d9e36-7775-45a5-b8ce-831e53765975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:01.884455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9e36-7775-45a5-b8ce-831e53765975 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.884937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9e36-7775-45a5-b8ce-831e53765975 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.885396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d9e36-7775-45a5-b8ce-831e53765975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.886723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d9e36-7775-45a5-b8ce-831e53765975 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=146b6b09371b4deb940ad1fb924ea984) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:01.887261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d9e36-7775-45a5-b8ce-831e53765975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:01.889938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d9e36-7775-45a5-b8ce-831e53765975 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:01.900935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:01.901874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:01.902732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:01.902732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:01.902732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:01.902732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 272/534] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:01.903376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:01.909950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 263/535] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/role_assignments?user.id=146b6b09371b4deb940ad1fb924ea984&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:01.912378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9318-9df3-4f01-8619-7345640cdbfd None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:01.912857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9318-9df3-4f01-8619-7345640cdbfd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:01.913320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9318-9df3-4f01-8619-7345640cdbfd None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:01.927603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 264/536] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:01 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:01.931179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c9318-9df3-4f01-8619-7345640cdbfd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:02.003451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:02.122153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050a68-68cb-4286-9c6d-7266ca9d9c9e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:02.160047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:02.163851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c9318-9df3-4f01-8619-7345640cdbfd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:02.175994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513e216-5a20-4c1e-a02c-a827616f1963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:02.177816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513e216-5a20-4c1e-a02c-a827616f1963 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.178429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513e216-5a20-4c1e-a02c-a827616f1963 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.178914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513e216-5a20-4c1e-a02c-a827616f1963 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.179877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513e216-5a20-4c1e-a02c-a827616f1963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:02.180422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513e216-5a20-4c1e-a02c-a827616f1963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:02.182228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513e216-5a20-4c1e-a02c-a827616f1963 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:02.199681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 273/537] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:02.201430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dac9f-0626-47be-ab37-690665251aa7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.202548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dac9f-0626-47be-ab37-690665251aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.203053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963dac9f-0626-47be-ab37-690665251aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.229219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-963dac9f-0626-47be-ab37-690665251aa7 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:02.231216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-963dac9f-0626-47be-ab37-690665251aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:02.261661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:02.263432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.264033 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.264672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.265640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:02.266163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:02.273894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:02.302326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 265/538] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:02.305506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:02.400558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 274/539] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:02.402165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dac9f-0626-47be-ab37-690665251aa7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:02.599001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:02.603417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963dac9f-0626-47be-ab37-690665251aa7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:02.626782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:02.642833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:02.643865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.643985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596d357-364c-4600-98c3-f296ca18c11c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:02.644154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.644422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.653221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:02.654822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:02.678205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:02.679184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:02.680012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:02.680921 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 275/540] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:02.692373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:02.713843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3f331-85f9-4262-bab9-5491943cf5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:02.714917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3f331-85f9-4262-bab9-5491943cf5ec None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.715455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3f331-85f9-4262-bab9-5491943cf5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.715932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3f331-85f9-4262-bab9-5491943cf5ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.716943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3f331-85f9-4262-bab9-5491943cf5ec None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=916a9bae3ca94918af4efdfcae19d928) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:02.717498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3f331-85f9-4262-bab9-5491943cf5ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:02.719520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3f331-85f9-4262-bab9-5491943cf5ec None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:02.727053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 266/541] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:02 2022] GET /identity/v3/role_assignments?user.id=916a9bae3ca94918af4efdfcae19d928&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 259 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:02.742200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c4ec8-9375-4e0e-9d07-ea67c95cd3ec None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.742878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c4ec8-9375-4e0e-9d07-ea67c95cd3ec None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.743410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c4ec8-9375-4e0e-9d07-ea67c95cd3ec None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.750303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 267/542] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:02.760921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242dd8b-fe19-4d20-86d4-46b45af61b59 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.767030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242dd8b-fe19-4d20-86d4-46b45af61b59 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.767839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242dd8b-fe19-4d20-86d4-46b45af61b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.807644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a242dd8b-fe19-4d20-86d4-46b45af61b59 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:02.810344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a242dd8b-fe19-4d20-86d4-46b45af61b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:02.903907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b05613-14fb-4fa7-9ad3-574be316ddb2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:02.934285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 268/543] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 08:02:02.936032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242dd8b-fe19-4d20-86d4-46b45af61b59 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:02.951846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:02.952462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:02.952741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:02.953013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:02.953714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:02.954019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:02.955516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:02.969734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 276/544] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:02.975716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.054696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:03.145872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:03.181279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242dd8b-fe19-4d20-86d4-46b45af61b59 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.185514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9d894-5fb9-4734-8135-252dba84db68 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.228574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.229607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.230099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.230650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.259279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:03.260972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.262063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.262587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.263154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.264582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=43048122a82e4562babb240ff090d5f5) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:03.265098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:03.265898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:03.266766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:03.267518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:03.269211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:03.278743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 269/545] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:03.280890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 277/546] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:02 2022] GET /identity/v3/role_assignments?user.id=43048122a82e4562babb240ff090d5f5&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:03.288048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.440363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17f71f-58c8-4b54-b305-07d349f35d4f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.499611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.500621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.501112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.501573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.502561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:03.503081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:03.504699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:03.519831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 270/547] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:03.528587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.530041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.548512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:03.760205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787d91-2ffd-417f-8987-a091af764773 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.764529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554af5ab-2610-4371-bf26-a54155902cea None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:03.767680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:03.849261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.850859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.851628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.852365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.870709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:03.872291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:03.873038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:03.873755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:03.894992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:03.898098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:03.917524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:03.932746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:03.934563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:03.935998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:03.943179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 271/548] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:03.956293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:03.958328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:03.960006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:03.960006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:03.960006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:03.962661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 278/549] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:03.963355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:03.967490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.177376 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:04.209385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1a40-b2ed-4049-9516-da016f0387a8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.236813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f0d61-93a8-46f8-a1f7-029f1d1f87f5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.291590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.292212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.292482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.292749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.293439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:04.293734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:04.295144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:04.307905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f71480-3b56-42e9-b614-76101858793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.308523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71480-3b56-42e9-b614-76101858793b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.308801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71480-3b56-42e9-b614-76101858793b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.309063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f71480-3b56-42e9-b614-76101858793b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.309718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f71480-3b56-42e9-b614-76101858793b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:04.310013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f71480-3b56-42e9-b614-76101858793b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:04.311433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f71480-3b56-42e9-b614-76101858793b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:04.318298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 272/550] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:04.325493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.342743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 279/551] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:04.351527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f71480-3b56-42e9-b614-76101858793b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.402396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:04.529273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfa55-a6fb-4653-b231-59eceac7c3d0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.607649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:04.648863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f71480-3b56-42e9-b614-76101858793b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:04.651438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.652561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.653049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.653629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.695438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:04.698080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:04.723071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:04.724504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:04.725167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:04.725875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:04.737251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:04.739337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:04.741251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:04.741251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:04.741251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:04.742460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 273/552] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:04.751167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:04.754886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:04.762153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:04.787392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:04.789436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:04.791562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:04.795533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 280/553] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:04.811604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:04.999490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.055450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32937e-09ef-478e-a664-e228667e61a5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.078796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11176e-cc5b-46aa-88a5-82f8bbe132b9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.134779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.135400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.135676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.135945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.136694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:05.136995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.138505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.168360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.168986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.169263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.169526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.170187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:05.170514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.171917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.185306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 281/554] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:05.189031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.193590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 274/555] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:05.202149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.317777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.404565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a53bf-0501-4efd-a020-b07a1a3eda68 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.442354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bbdf8-fb67-4b65-9d82-cf35a6d4106d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.448583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.459087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b66288f-e35b-49b6-a441-333452578968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.459907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66288f-e35b-49b6-a441-333452578968 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.460350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66288f-e35b-49b6-a441-333452578968 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.460703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b66288f-e35b-49b6-a441-333452578968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.474495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66288f-e35b-49b6-a441-333452578968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.476168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b66288f-e35b-49b6-a441-333452578968 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.491543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02808e3a-c0dd-42ab-8e59-c70b76a8e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.492200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02808e3a-c0dd-42ab-8e59-c70b76a8e5db None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.492482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02808e3a-c0dd-42ab-8e59-c70b76a8e5db None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.492758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02808e3a-c0dd-42ab-8e59-c70b76a8e5db None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6b66288f-e35b-49b6-a441-333452578968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:05.495160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:05.496498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:05.497822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:05.497822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:05.497822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:05.500795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02808e3a-c0dd-42ab-8e59-c70b76a8e5db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.501388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 282/556] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:05.503281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02808e3a-c0dd-42ab-8e59-c70b76a8e5db None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.503465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346e32-af84-4487-9e3e-aca0bf13abcd None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.503880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346e32-af84-4487-9e3e-aca0bf13abcd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.504240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346e32-af84-4487-9e3e-aca0bf13abcd None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.506398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 283/557] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:05.507589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346e32-af84-4487-9e3e-aca0bf13abcd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-02808e3a-c0dd-42ab-8e59-c70b76a8e5db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:05.519463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:05.521121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 275/558] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:05.523144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f34960-a8a5-40ac-a125-97748cd5d805 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.524443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f34960-a8a5-40ac-a125-97748cd5d805 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.524443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f34960-a8a5-40ac-a125-97748cd5d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.545642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-78f34960-a8a5-40ac-a125-97748cd5d805 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:05.547083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-78f34960-a8a5-40ac-a125-97748cd5d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:05.630961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 276/559] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:05.631946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f34960-a8a5-40ac-a125-97748cd5d805 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.635576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346e32-af84-4487-9e3e-aca0bf13abcd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.671819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.675100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.676154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.676494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.676774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.677437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:05.677736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.679521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.694124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 284/560] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:05.699823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.753565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.759862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f34960-a8a5-40ac-a125-97748cd5d805 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.801926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c2e68-71ff-4d32-9c8e-84cb01c902f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.802588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c2e68-71ff-4d32-9c8e-84cb01c902f1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.802850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c2e68-71ff-4d32-9c8e-84cb01c902f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.803128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c2e68-71ff-4d32-9c8e-84cb01c902f1 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.803986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c2e68-71ff-4d32-9c8e-84cb01c902f1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:05.804299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c2e68-71ff-4d32-9c8e-84cb01c902f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.805772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c2e68-71ff-4d32-9c8e-84cb01c902f1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.817445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bb5b0-bcc1-4d2c-b8a8-af40777dcf6f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.827012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 277/561] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:05.828499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494cf1-eecb-4180-8b4d-5eeb494e5705 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.828792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494cf1-eecb-4180-8b4d-5eeb494e5705 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.829068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494cf1-eecb-4180-8b4d-5eeb494e5705 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.831750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 278/562] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:05.834895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21494cf1-eecb-4180-8b4d-5eeb494e5705 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:05.857317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d40d10-d3f9-446c-a979-04e55354adf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:05.857882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d40d10-d3f9-446c-a979-04e55354adf8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.858159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d40d10-d3f9-446c-a979-04e55354adf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.858557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d40d10-d3f9-446c-a979-04e55354adf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.866822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d40d10-d3f9-446c-a979-04e55354adf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:05.868358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d40d10-d3f9-446c-a979-04e55354adf8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-88d40d10-d3f9-446c-a979-04e55354adf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:05.881603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:05.884912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 285/563] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921ac9-29e2-4fdd-b696-e6ac954dd66f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:05.894882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921ac9-29e2-4fdd-b696-e6ac954dd66f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:05.896817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31921ac9-29e2-4fdd-b696-e6ac954dd66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:05.911533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-31921ac9-29e2-4fdd-b696-e6ac954dd66f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:05.912945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-31921ac9-29e2-4fdd-b696-e6ac954dd66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:05.949163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:05.961504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21494cf1-eecb-4180-8b4d-5eeb494e5705 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:05.994741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 286/564] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:05.995987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31921ac9-29e2-4fdd-b696-e6ac954dd66f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.002778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.003716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.004001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.004277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.037146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.086580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.088410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.116176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31921ac9-29e2-4fdd-b696-e6ac954dd66f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.155748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.156758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.157224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.157675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.159253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:06.159916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.161601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.180947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 287/565] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.182325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.196586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.209283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 279/566] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:06.210146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.295469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.307333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9b83a-615a-4981-98d3-c8cc61d37841 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.335604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519dd39-86fc-4f7a-ba95-96ae57b58472 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.350540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.351546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.352036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.352485 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.365865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:06.372341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:06.373295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:06.374098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:06.378776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 288/567] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:06.378776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.381009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.381694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.381977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.382277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/3a545f5fde0d432fbe31819eb5c7c39d/roles/cb1108a3a43e41cb83124569db481d4a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.400796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=3a545f5fde0d432fbe31819eb5c7c39d, role_id=cb1108a3a43e41cb83124569db481d4a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.402209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.418791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 280/568] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:06 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/3a545f5fde0d432fbe31819eb5c7c39d/roles/cb1108a3a43e41cb83124569db481d4a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:06.419693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.489959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.575669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379259-941d-4ff0-a657-09aceaf229be None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.577558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe7814-7b9a-4886-bc03-fe05e90ad4b9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.638548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.639098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.639377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.639648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.646384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35861395-2fc8-431b-8202-45f0c9e1e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.647478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861395-2fc8-431b-8202-45f0c9e1e786 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.648145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861395-2fc8-431b-8202-45f0c9e1e786 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.648529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861395-2fc8-431b-8202-45f0c9e1e786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.653048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.654877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.667905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861395-2fc8-431b-8202-45f0c9e1e786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:06.672489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:06.673447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:06.675992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:06.675992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:06.675992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:06.675992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 289/569] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:06.675992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-35861395-2fc8-431b-8202-45f0c9e1e786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:06.682302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:06.683849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 281/570] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:06.685096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98dfd-d757-4e12-a0c4-2b97e93ef7df None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.686218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98dfd-d757-4e12-a0c4-2b97e93ef7df None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.686218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e98dfd-d757-4e12-a0c4-2b97e93ef7df None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.686218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 282/571] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:06.686218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e98dfd-d757-4e12-a0c4-2b97e93ef7df None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.699734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.841839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc49ce-d58a-4473-965f-4f8e6612784b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.857596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:06.865805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e98dfd-d757-4e12-a0c4-2b97e93ef7df None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:06.881468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.882307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.882418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.882651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.883327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:06.883663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.885015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.898881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 290/572] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.898881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:06.920919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9ccc6-7107-4c82-8802-9462d1331a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:06.921721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ccc6-7107-4c82-8802-9462d1331a80 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.922230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ccc6-7107-4c82-8802-9462d1331a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.922671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9ccc6-7107-4c82-8802-9462d1331a80 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.923670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9ccc6-7107-4c82-8802-9462d1331a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:06.924726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9ccc6-7107-4c82-8802-9462d1331a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:06.926306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9ccc6-7107-4c82-8802-9462d1331a80 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:06.952063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 283/573] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:06.952063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e6ae-7f30-4695-aa04-129f72d97e66 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:06.952063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e6ae-7f30-4695-aa04-129f72d97e66 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:06.952063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2e6ae-7f30-4695-aa04-129f72d97e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:06.977733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4ba2e6ae-7f30-4695-aa04-129f72d97e66 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:06.979919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4ba2e6ae-7f30-4695-aa04-129f72d97e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:06.996587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.047227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65937360-7965-4442-8ffe-e6adf9f15c14 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.106275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 284/574] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:07.106275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2e6ae-7f30-4695-aa04-129f72d97e66 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.118189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.119298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.119829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.120357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.121694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:07.122204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.124836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.146922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 291/575] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:07.146922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.289490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.305602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772157bd-4190-4ae9-bad3-fb1a7c6e67bb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.306111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2e6ae-7f30-4695-aa04-129f72d97e66 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.341944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.350279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.351385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.351891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.352360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.356261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.357593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.358116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.358625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.367750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.370042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.372008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.374042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:07.387939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:07.388885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:07.389774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:07.390728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 292/576] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:07.391855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:07.397649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:07.398634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:07.399507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:07.399507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:07.399507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:07.402090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 285/577] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:07.402090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.525567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e28fb-6d38-4fe0-b8f8-425c928d4f53 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.549942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903da36-ec56-4c13-9e76-762959a953c6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.571086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.572205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.572634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.573106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.596341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.598023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.610295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.610919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.611199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.612179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.613965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:07.614360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.615836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:07.616897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:07.617794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:07.618700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:07.618700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:07.618700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:07.618700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 293/578] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:07.619683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.642439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 286/579] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:07.644180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.647611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.684208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.761674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f9ddc-3f86-4738-b586-43cabd869a62 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.795187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ea548-4af0-4c60-ba7e-6438f8e53d02 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.806611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.807530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.808004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.808480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.809638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:07.810176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:07.812616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:07.834290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 294/580] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:07.835901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.844893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:07.846421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:07.847566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:07.848006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:07.876811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:07.883388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:07.884758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 287/581] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:07.885654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:07.969416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:07.976127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1e53-6816-42f5-ab95-a707035fc66a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:07.978558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.017260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2d2db-9acc-4590-9f11-22acfea73f6d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.027017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.027835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.028011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.028279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.028935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:08.029234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.030660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.045241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 295/582] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:08.052051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.068417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.069098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.069567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.069995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.071107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=631f5f7d18ab4574843a667ef17429ab) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:08.071531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.073197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.080044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 288/583] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:07 2022] GET /identity/v3/role_assignments?user.id=631f5f7d18ab4574843a667ef17429ab&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:08.081646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.209236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac98e9-89a2-4be7-b5d5-f3c60d24464b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.218105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec0ee5-2082-408a-8bb3-9a297436c617 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.257614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.268456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.269079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.269362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.269636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.270392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:08.270697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.271326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.272102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.272437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.272905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.273362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.284697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.286595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 289/584] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:08.286912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.287644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:08.303953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:08.304944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:08.305847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:08.307732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 296/585] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:08.312925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.351623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.442874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac534b-20be-49eb-9120-54d34ada14cd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.474259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9623e5-d945-4543-9f17-892f9937aaa4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.489634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.490458 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.490743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.491020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.501305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.503928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:08.518829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:08.520222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:08.521341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:08.522430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.523234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.523748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.524172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.524905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 290/586] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:08.525804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.538962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.540514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:08.559044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:08.560217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:08.561186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:08.561186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:08.561186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:08.563382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 297/587] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:08.564997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.619391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.667543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.691152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33275e8-5c07-4f1c-8fd5-23aafe66ebd8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.700216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a964bc-656c-4370-9921-89660c489338 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.737899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c879e7-ebfe-48e7-b23c-d8caa5f7bba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.738910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c879e7-ebfe-48e7-b23c-d8caa5f7bba0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.739289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c879e7-ebfe-48e7-b23c-d8caa5f7bba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.739557 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c879e7-ebfe-48e7-b23c-d8caa5f7bba0 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.740303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c879e7-ebfe-48e7-b23c-d8caa5f7bba0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:08.740634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c879e7-ebfe-48e7-b23c-d8caa5f7bba0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.741174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.741820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.742062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c879e7-ebfe-48e7-b23c-d8caa5f7bba0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.742165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.742399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.743150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:08.743456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.744885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.764093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 298/588] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:08.764968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.765949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 291/589] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:08.767537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad95a91-0a2a-4349-871a-ea18b8af1a77 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.768546 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad95a91-0a2a-4349-871a-ea18b8af1a77 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.768995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad95a91-0a2a-4349-871a-ea18b8af1a77 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.770780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 292/590] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:08.771702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad95a91-0a2a-4349-871a-ea18b8af1a77 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:08.905318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff038ca8-da7a-4f3b-91f0-c052d9fbf212 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.910890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad95a91-0a2a-4349-871a-ea18b8af1a77 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:08.923423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.953846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:08.961238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.964172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.964692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.965277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.966665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:08.967179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.968331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7af29-916b-45e6-a5f2-6980f5d96d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:08.968971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7af29-916b-45e6-a5f2-6980f5d96d0b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:08.969249 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7af29-916b-45e6-a5f2-6980f5d96d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:08.969345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.969524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7af29-916b-45e6-a5f2-6980f5d96d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:08.981762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7af29-916b-45e6-a5f2-6980f5d96d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:08.984442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7af29-916b-45e6-a5f2-6980f5d96d0b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:08.990276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 299/591] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:08.991441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-dcb7af29-916b-45e6-a5f2-6980f5d96d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:09.015459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:09.016562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:09.017476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:09.017476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:09.017476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:09.017476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 293/592] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:09.019008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1210a4-f818-4278-b5c3-02f39a795b96 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:09.019301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1210a4-f818-4278-b5c3-02f39a795b96 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:09.019576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1210a4-f818-4278-b5c3-02f39a795b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:09.040382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ef1210a4-f818-4278-b5c3-02f39a795b96 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:09.041613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ef1210a4-f818-4278-b5c3-02f39a795b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:09.138220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 294/593] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:09.139738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1210a4-f818-4278-b5c3-02f39a795b96 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.163981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425789b5-f2b5-42f4-ba4b-3c33870452d7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:09.212674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:09.213823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:09.214228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:09.214717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:09.235778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:09.239091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:09.276310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:09.277919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:09.278898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:09.278898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:09.278898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:09.283106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 300/594] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:09.284976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.353922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:09.378016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:09.379784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1210a4-f818-4278-b5c3-02f39a795b96 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:09.422034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:09.422763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:09.423243 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:09.423617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:09.432788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:09.434455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:09.448417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:09.450359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:09.452593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:09.454730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 295/595] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:09.456526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.494188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc08a27-a3f5-44ef-86a2-674adaa5a7c0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:09.561704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:09.563177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:09.564144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:09.565499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:09.566937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:09.567830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:09.570783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:09.574170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac7345-6415-42de-b552-d77e81b84f15 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:09.595886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 301/596] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:09.597909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.620470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:09.621587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:09.621587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:09.621895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:09.622549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:09.622850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:09.624252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:09.641234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 296/597] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:09.646833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.659937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:09.770535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06906f7-5a89-4494-bf0a-d17cb2655375 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:09.803456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578420-7acb-4e26-b2ef-47b6ce85a4fb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:09.807621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:09.814361 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:09.815718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:09.816165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:09.816402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:09.825996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:09.827547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:09.840941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:09.843040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 297/598] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:09.844714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.874722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:09.875688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:09.876122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:09.876546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:09.878488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:09.878976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:09.881446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:09.915330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 302/599] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Sep 1 08:02:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:09.916503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:09.960357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:10.014264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0977e-80e5-4b39-a96f-eb45d336fa9d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.063908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:10.065540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.066067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.066572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.079027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:10.081876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:10.090595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab416c-407d-4458-80b6-ebc8ae8a568f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:10.105427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:10.107242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 298/600] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:10.109448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:10.135684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:10.136322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.136614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.136904 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.148474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:10.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:10.155456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 303/601] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:10.157518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:10.196534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:10.276956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa238b9d-b1c9-4a47-931c-b239b6be7924 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.309570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1283e02-e7b3-4364-b8fd-967524de46c6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.313233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:10.326545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0df44-e6e2-4c4d-ba88-6cbcb116b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:10.327064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0df44-e6e2-4c4d-ba88-6cbcb116b195 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.327342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0df44-e6e2-4c4d-ba88-6cbcb116b195 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.327614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0df44-e6e2-4c4d-ba88-6cbcb116b195 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.328336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0df44-e6e2-4c4d-ba88-6cbcb116b195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:10.328633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0df44-e6e2-4c4d-ba88-6cbcb116b195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:10.330117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0df44-e6e2-4c4d-ba88-6cbcb116b195 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:10.343086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 299/602] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:10.344362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7d6d-c0c1-4ac4-90dc-a6740c00fde8 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.344646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7d6d-c0c1-4ac4-90dc-a6740c00fde8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.344923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7d6d-c0c1-4ac4-90dc-a6740c00fde8 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.346838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 300/603] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:10.347322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a7d6d-c0c1-4ac4-90dc-a6740c00fde8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:10.362579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:10.363532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.364423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.364423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.376525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:10.379408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:10.400663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:10.402696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:10.404567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:10.404567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:10.404567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:10.404567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 304/604] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:10.404567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:10.469815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a7d6d-c0c1-4ac4-90dc-a6740c00fde8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.493796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:10.508746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:10.509454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.509796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.510131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.510932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:10.511308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:10.512831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:10.526820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 301/605] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:10.528388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:10.535489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddbaeb-7f60-499f-86a4-b8a135dc8cf4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.584749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9204a-5c49-4612-98c8-62b801891aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:10.585423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9204a-5c49-4612-98c8-62b801891aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.585800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9204a-5c49-4612-98c8-62b801891aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.586215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9204a-5c49-4612-98c8-62b801891aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.587210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:10.587507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9204a-5c49-4612-98c8-62b801891aa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:10.587915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9204a-5c49-4612-98c8-62b801891aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:10.589437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9204a-5c49-4612-98c8-62b801891aa6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:10.600987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 305/606] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:10.602344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344884c8-7412-48e3-978a-75a9159c8526 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.602670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344884c8-7412-48e3-978a-75a9159c8526 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.602945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344884c8-7412-48e3-978a-75a9159c8526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.622715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-344884c8-7412-48e3-978a-75a9159c8526 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:10.623937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-344884c8-7412-48e3-978a-75a9159c8526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:10.667131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c98afe-9b06-45bb-880e-e860aa285d01 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.714321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 306/607] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:10.714584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:10.714801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344884c8-7412-48e3-978a-75a9159c8526 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:10.714956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:10.714956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:10.714956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/916a9bae3ca94918af4efdfcae19d928/roles/cb1108a3a43e41cb83124569db481d4a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:10.745728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=916a9bae3ca94918af4efdfcae19d928, role_id=cb1108a3a43e41cb83124569db481d4a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:10.747778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:10.774321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 302/608] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:10 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/916a9bae3ca94918af4efdfcae19d928/roles/cb1108a3a43e41cb83124569db481d4a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:10.774321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:10.871861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:10.950111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344884c8-7412-48e3-978a-75a9159c8526 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:10.983823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:10.996271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd7dc0-8346-4d19-8806-91c7f7bf3796 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:11.016093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:11.017064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.017347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.018167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.019312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:11.019584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:11.021128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:11.036370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 307/609] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:11.037233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.062836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:11.067818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.068358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.068826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/146b6b09371b4deb940ad1fb924ea984/roles/cb1108a3a43e41cb83124569db481d4a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.098545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=146b6b09371b4deb940ad1fb924ea984, role_id=cb1108a3a43e41cb83124569db481d4a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:11.101216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:11.125116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 303/610] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:10 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/146b6b09371b4deb940ad1fb924ea984/roles/cb1108a3a43e41cb83124569db481d4a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:11.126558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.211394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069a45b-2d10-4e2b-b022-20ec035f8bb2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:11.258328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:11.279594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:11.279594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.279594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.279594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.303614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:11.307087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:11.337907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:11.339826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:11.348107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:11.348107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:11.348107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:11.348107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 308/611] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:11.348107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.368367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd545a-7db4-487a-8e0c-5d20ebe12de5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:11.442328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:11.443853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.444659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.445433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.465558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:11.476688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:11.478579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:11.480251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:11.485209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 304/612] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:11.487774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.509435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:11.512473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6e06a-00a5-445e-9025-c10ad8d57186 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:11.569633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:11.570295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.570582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.570854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.579049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:11.580655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:11.597244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:11.599011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 309/613] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:11.601315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.663270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:11.700914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb32a49-564b-482b-a187-a77999cfa4cb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:11.763184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:11.765394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.766543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.767588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.769306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:11.770597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:11.773315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:11.797684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d225eb-6f1b-4176-b18c-3ad0494d0914 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:11.804926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 305/614] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:11.804926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.868466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:11.869621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:11.870095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:11.870592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:11.872161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:11.873056 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:11.875452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:11.887935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 310/615] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:11.889697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:11.963610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.026359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb42a37-b59e-4ef1-bd15-c9bb55428169 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.068540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.075224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e702b0-c507-43b8-a5d6-b022eb6c2050 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.086544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.087502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.087967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.088435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.089646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:12.090171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.093400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.117834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 306/616] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:12.119363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.147587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.149196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.149930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.150710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.166432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.169960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:12.193847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:12.195934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:12.197786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:12.206346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 311/617] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:12.208218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.302595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595bf238-89cd-4aa2-8189-7b967e862520 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.353639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.369932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.371644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.372354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.373868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.400154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.403547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.420052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca7b00-2446-480a-bce9-13a980c36758 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:12.441124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:12.443339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:12.445195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:12.445195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:12.445195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:12.449242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 307/618] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:12.451315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.494575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.495796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.496367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.496931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/43048122a82e4562babb240ff090d5f5/roles/cb1108a3a43e41cb83124569db481d4a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.520342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=43048122a82e4562babb240ff090d5f5, role_id=cb1108a3a43e41cb83124569db481d4a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.522794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.542599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 312/619] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:12 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/43048122a82e4562babb240ff090d5f5/roles/cb1108a3a43e41cb83124569db481d4a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:12.543677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.560025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.657225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f54bad-ed19-45b8-8dab-01deb87b48bc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.688776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055c31c-3f57-44b4-8532-01d4870aba18 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:12.749178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.750366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.752486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.755328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.756713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:12.758564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.759439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:12.761052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:12.761504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:12.762623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.763143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:12.764123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:12.766380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:12.770363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:12.791750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 313/620] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:12.801042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.811346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 308/621] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:12.818277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:12.878663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.933249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:12.985160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7af148-354f-4afb-b456-002f78ae2be8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.069993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144ad59-1c07-4e14-83e1-8dda786f80cf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.088836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.089856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.090364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.090801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.171082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.171756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.172043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.172323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.192226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.195118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.210114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.211630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:13.247492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:13.248512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:13.249434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:13.250550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 314/622] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:13.259878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.266534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.327538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 309/623] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:13.335096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.451399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67cc1e4-4118-4fb3-b39c-7b8e6cc096d0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.490790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.508629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47454677-f052-4e4c-8926-0381891210ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.510966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47454677-f052-4e4c-8926-0381891210ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.512175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47454677-f052-4e4c-8926-0381891210ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.512857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47454677-f052-4e4c-8926-0381891210ea None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.515448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47454677-f052-4e4c-8926-0381891210ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:13.516412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47454677-f052-4e4c-8926-0381891210ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.521168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47454677-f052-4e4c-8926-0381891210ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.534399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4bfaa-297e-4780-8fd7-e75702af5e1b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.566264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 315/624] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:13.569630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7ded7-fe87-40c3-8c96-edaa4be6dd2d None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.570112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7ded7-fe87-40c3-8c96-edaa4be6dd2d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.571096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7ded7-fe87-40c3-8c96-edaa4be6dd2d None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.573254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 316/625] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:13.575037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7ded7-fe87-40c3-8c96-edaa4be6dd2d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.585496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a94a8-ba3e-4277-8394-8d3e85a498bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.586426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a94a8-ba3e-4277-8394-8d3e85a498bf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.586855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a94a8-ba3e-4277-8394-8d3e85a498bf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.587273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a94a8-ba3e-4277-8394-8d3e85a498bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.595282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.604276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a94a8-ba3e-4277-8394-8d3e85a498bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.606000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a94a8-ba3e-4277-8394-8d3e85a498bf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-873a94a8-ba3e-4277-8394-8d3e85a498bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:13.628126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:13.629322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:13.630217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:13.630217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.630217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:13.640600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 310/626] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:13.640600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6ce1-afe1-49dc-b3dc-994535bb9df3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.640600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6ce1-afe1-49dc-b3dc-994535bb9df3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.640600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee6ce1-afe1-49dc-b3dc-994535bb9df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.660920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-00ee6ce1-afe1-49dc-b3dc-994535bb9df3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:13.662171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-00ee6ce1-afe1-49dc-b3dc-994535bb9df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:13.740375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7ded7-fe87-40c3-8c96-edaa4be6dd2d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.741780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 311/627] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:13.743036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6ce1-afe1-49dc-b3dc-994535bb9df3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.826817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.827469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.827748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.828017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.850153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.851572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:13.878165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:13.879164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:13.880100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:13.880100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:13.880100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:13.881241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 317/628] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:13.888809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:13.905295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee6ce1-afe1-49dc-b3dc-994535bb9df3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:13.937438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:13.972664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:13.973312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:13.973597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:13.973877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:13.974612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:13.974920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:13.976375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:13.994799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:14.004744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 312/629] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:14.010696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.114066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a788b-e83b-4a25-8e34-0349e1272c5a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.152973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c511a6-8f68-4991-a37c-1bfebc477242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.153604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c511a6-8f68-4991-a37c-1bfebc477242 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.153945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c511a6-8f68-4991-a37c-1bfebc477242 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.154376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c511a6-8f68-4991-a37c-1bfebc477242 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.154858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c511a6-8f68-4991-a37c-1bfebc477242 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:14.155258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c511a6-8f68-4991-a37c-1bfebc477242 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.156694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c511a6-8f68-4991-a37c-1bfebc477242 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.176717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 318/630] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:14.176717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd992813-3d85-4435-ab06-dd44a97d8353 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.176717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd992813-3d85-4435-ab06-dd44a97d8353 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.176717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd992813-3d85-4435-ab06-dd44a97d8353 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.176717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 319/631] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:14.177805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd992813-3d85-4435-ab06-dd44a97d8353 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.205593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8566e41-0bc3-4bc5-ba50-73f021bd02f0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.253215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.253936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.254204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.254522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.262348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.263833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:14.276866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:14.278637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:14.280196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:14.282902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 313/632] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:14.284513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.340521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:14.371379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:14.381058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd992813-3d85-4435-ab06-dd44a97d8353 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.417727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c599-0632-4403-84cc-ad0ff65ac72d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.456647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edac1b3-e6da-4ba5-9922-bde3ec034eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.457642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac1b3-e6da-4ba5-9922-bde3ec034eec None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.458091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac1b3-e6da-4ba5-9922-bde3ec034eec None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.458529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edac1b3-e6da-4ba5-9922-bde3ec034eec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.474856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edac1b3-e6da-4ba5-9922-bde3ec034eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:14.478777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.479851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1edac1b3-e6da-4ba5-9922-bde3ec034eec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:14.480034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:14.481740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:14.483464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:14.484994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.484994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.485233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 320/633] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:14.485233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3433b-60e0-40d5-854c-cb1977bde3f5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.485233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3433b-60e0-40d5-854c-cb1977bde3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.485233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3433b-60e0-40d5-854c-cb1977bde3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.501755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.504117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-91c3433b-60e0-40d5-854c-cb1977bde3f5 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:14.505087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.505562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-91c3433b-60e0-40d5-854c-cb1977bde3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:14.522992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:14.524806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 314/634] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:14.528204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.635290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 321/635] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:14.636712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3433b-60e0-40d5-854c-cb1977bde3f5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.771827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:14.777617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c27024-3c11-44e1-877a-8c9b4d58908f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.815308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:14.840479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3433b-60e0-40d5-854c-cb1977bde3f5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:14.847624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.848371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.848982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.849631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.851197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:14.851880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.854948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.886971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 315/636] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:14.888756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:14.919579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:14.921114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:14.921926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:14.922587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:14.924930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:14.925933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:14.929206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:14.950511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 322/637] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:14.952458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:15.085540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37db9f-44ab-47c2-adc0-ec4504ba0a91 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:15.153906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:15.155109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.155109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.155402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.156045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:15.156420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:15.158697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:15.173687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 316/638] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:15.175798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:15.197271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525ec3-8bcf-4973-bc93-600addc479eb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:15.216617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:15.257331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:15.258338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.258794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.259244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.260478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=3a545f5fde0d432fbe31819eb5c7c39d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:15.260995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:15.263400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:15.274102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 323/639] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:14 2022] GET /identity/v3/role_assignments?user.id=3a545f5fde0d432fbe31819eb5c7c39d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:15.275228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:15.308417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:15.363102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fdfe9-b874-4594-9cae-a72ac3698373 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:15.409937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:15.411439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.412185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.412875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.432786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:15.435761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:15.448601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b1d92-f717-439d-930e-e788f668ce04 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:15.464021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:15.465937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:15.467641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:15.467641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:15.467641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:15.469025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 317/640] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:15.471481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:15.503686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1928eb-e97f-4c4f-9f98-1a0bacdbf927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:15.504475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1928eb-e97f-4c4f-9f98-1a0bacdbf927 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.504822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1928eb-e97f-4c4f-9f98-1a0bacdbf927 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.505373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1928eb-e97f-4c4f-9f98-1a0bacdbf927 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.525710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1928eb-e97f-4c4f-9f98-1a0bacdbf927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3b1928eb-e97f-4c4f-9f98-1a0bacdbf927 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:15.534113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:15.535178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:15.536703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 324/641] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:15.537869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a094-3cae-4e3d-b6d6-06151ab2a06a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.539316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a094-3cae-4e3d-b6d6-06151ab2a06a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.539316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274a094-3cae-4e3d-b6d6-06151ab2a06a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.545382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 325/642] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:15.545382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274a094-3cae-4e3d-b6d6-06151ab2a06a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:15.615293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:15.671910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae6a1f-deb8-403a-92de-05454ee5b8b7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:15.676882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:15.707265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274a094-3cae-4e3d-b6d6-06151ab2a06a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:15.742324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f817f34-79a9-4f6f-a202-0c1e3040e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:15.743557 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f817f34-79a9-4f6f-a202-0c1e3040e44f None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.744145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f817f34-79a9-4f6f-a202-0c1e3040e44f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.744731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f817f34-79a9-4f6f-a202-0c1e3040e44f None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/631f5f7d18ab4574843a667ef17429ab/roles/cb1108a3a43e41cb83124569db481d4a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.753750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:15.754572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.754988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.755408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.756205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:15.756663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:15.758202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:15.773186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f817f34-79a9-4f6f-a202-0c1e3040e44f None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=631f5f7d18ab4574843a667ef17429ab, role_id=cb1108a3a43e41cb83124569db481d4a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:15.779506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 326/643] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:15.779506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:15.779875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f817f34-79a9-4f6f-a202-0c1e3040e44f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:15.810272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 318/644] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:15 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/631f5f7d18ab4574843a667ef17429ab/roles/cb1108a3a43e41cb83124569db481d4a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:15.810272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8289c0a-0fe3-4c89-aee1-9055bc529bdc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:15.810272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8289c0a-0fe3-4c89-aee1-9055bc529bdc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:15.810272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8289c0a-0fe3-4c89-aee1-9055bc529bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:15.842203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a8289c0a-0fe3-4c89-aee1-9055bc529bdc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:15.844817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a8289c0a-0fe3-4c89-aee1-9055bc529bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:15.978174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 319/645] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:15.980083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8289c0a-0fe3-4c89-aee1-9055bc529bdc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.019167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96fa21-522b-4946-9fbc-188599ce5853 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.102362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.103402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.103893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.104382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.105837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:16.106394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:16.109191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:16.114106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:16.128751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 327/646] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:16.130747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:16.138039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.247093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8289c0a-0fe3-4c89-aee1-9055bc529bdc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.346327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.347247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.347737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.348718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.365721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63265cb8-9078-43d9-875f-23a85b8c8cca None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.374993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:16.377635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:16.426640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:16.428459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:16.431379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 320/647] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:16.442274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.469928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.471591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.472058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.472517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.509402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:16.511849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:16.560317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:16.562158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:16.563834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:16.563834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:16.563834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:16.572078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 328/648] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:16.579618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.676606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834f31c-4a2f-4b11-b1d0-e3fab2316f67 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.680581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:16.704766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:16.748292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.749734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.750424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.751116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.754265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:16.755156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:16.758231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:16.787278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e8881-5617-462b-a7be-5c90c108e2f6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:16.795057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 321/649] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:16.796889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:16.865813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:16.866856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:16.868492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:16.868971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:16.870101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:16.870644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:16.873072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:16.899439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 329/650] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:16.899439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.001560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165cabe-6a42-45b1-89e2-6445b74a1f34 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.066737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.067972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.068435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.068925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.088862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:17.099368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:17.100355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:17.101183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:17.102579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 322/651] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:17.106267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.117207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d735e-1ba3-45c1-a229-05519dbc6f1c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.130877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.150705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.164844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.165722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.166149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.166596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.245744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6b92-6a7a-4ef7-a5d2-ab0f2adcb525 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.251524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.253673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.292532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.293183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.293467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.293740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.303394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.305324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:17.321389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:17.322386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 323/652] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:17.328691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.392475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 330/653] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:17.393730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.407289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.443138 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.456150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dc09d-e83d-407d-bf07-acdfdbc4c507 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.496077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.497325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.497857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.498720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.499658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:17.500183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.503049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.518757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 324/654] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:17.520696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.528004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d9c9f-6b9c-4f62-8001-227d06aa720f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.593656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.594488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.594774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.595134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.596519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:17.596822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.598987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.630880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 331/655] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:17.632721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.665623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb94055-b033-454b-a659-3ab10ae256ea None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.711456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.713247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.714034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.714813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.717518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.743510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.747232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.755758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815c84f-bad9-4826-8ed6-23ef1dc03407 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:17.778639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:17.780415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:17.782186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:17.782186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:17.782186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:17.786230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 325/656] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:17.788079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.795116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:17.796362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:17.797928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:17.797928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:17.797928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:17.812136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:17.813892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:17.835448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:17.837173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:17.839392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:17.839392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:17.839392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:17.842667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 332/657] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:17.843822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:17.971234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40566b1b-7e9d-43d7-b012-6d70af0e71b8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:17.982970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab02d3-a4dc-426d-bb98-da886502a52d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.010459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.010875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.011055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.011346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.012061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.030770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.031967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.032594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.033953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.035275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:18.035872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.037458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.054612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 333/658] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:18.056373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.111687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.114749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.119162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.223210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939a011-07c8-4fcd-b728-3f7a7fcd0e51 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.264497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe0ec6-f9c9-4506-95bd-b8c5de8e664d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.265113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe0ec6-f9c9-4506-95bd-b8c5de8e664d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.265382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe0ec6-f9c9-4506-95bd-b8c5de8e664d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.266179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe0ec6-f9c9-4506-95bd-b8c5de8e664d None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.266871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe0ec6-f9c9-4506-95bd-b8c5de8e664d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:18.267255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe0ec6-f9c9-4506-95bd-b8c5de8e664d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.269281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe0ec6-f9c9-4506-95bd-b8c5de8e664d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.287380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 334/659] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:18.287380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f72e4-562b-4feb-af26-6cc687797271 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.287380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f72e4-562b-4feb-af26-6cc687797271 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.287380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f72e4-562b-4feb-af26-6cc687797271 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.287380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 335/660] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:18.287380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f72e4-562b-4feb-af26-6cc687797271 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.301530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 326/661] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:18.301530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.344757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.420809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f72e4-562b-4feb-af26-6cc687797271 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.425522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55365378-3d59-4d55-8ff3-6806736dafc9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.428687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.466091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab611024-1146-46cb-b2ea-eafe08c09d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.466770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611024-1146-46cb-b2ea-eafe08c09d90 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.467053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611024-1146-46cb-b2ea-eafe08c09d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.467332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab611024-1146-46cb-b2ea-eafe08c09d90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.473861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.474770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.475223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.475641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.478018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611024-1146-46cb-b2ea-eafe08c09d90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.480141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab611024-1146-46cb-b2ea-eafe08c09d90 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.484989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.487411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-ab611024-1146-46cb-b2ea-eafe08c09d90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:18.495291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.496216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:18.497092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:18.498570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 336/662] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.500067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdc5f8-0072-4dad-aefc-ff80f49b7cb3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:18.500181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.501129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:18.502793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 327/663] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.504070 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.504617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdc5f8-0072-4dad-aefc-ff80f49b7cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.505153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fdc5f8-0072-4dad-aefc-ff80f49b7cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.526018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-63fdc5f8-0072-4dad-aefc-ff80f49b7cb3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:18.527743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-63fdc5f8-0072-4dad-aefc-ff80f49b7cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:18.618448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 337/664] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:18.618448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdc5f8-0072-4dad-aefc-ff80f49b7cb3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.632083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77896d-c547-4f2f-85ff-d34a51fd49ba None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.650427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.672498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.674284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.674734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.675142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.690886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.692780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:18.711795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:18.712990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:18.714087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:18.714087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:18.714087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:18.716127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 328/665] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:18.717139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.741906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.751472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fdc5f8-0072-4dad-aefc-ff80f49b7cb3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.837009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.837657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.837939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.838210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.838947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:18.839250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.840693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.847511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9897f-e81e-4311-8117-21f546e9f3fe None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:18.854519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 338/666] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:18.855196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.902186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256e770-5262-40d4-99c5-a75fb225f5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:18.902825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e770-5262-40d4-99c5-a75fb225f5eb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.903104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e770-5262-40d4-99c5-a75fb225f5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.903371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256e770-5262-40d4-99c5-a75fb225f5eb None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.904122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256e770-5262-40d4-99c5-a75fb225f5eb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:18.904446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256e770-5262-40d4-99c5-a75fb225f5eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:18.906013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256e770-5262-40d4-99c5-a75fb225f5eb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:18.937353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 329/667] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:18.937353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04561fe-37e1-402d-90fb-5cfd3ddca292 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:18.937353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04561fe-37e1-402d-90fb-5cfd3ddca292 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:18.937353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04561fe-37e1-402d-90fb-5cfd3ddca292 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:18.937353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 330/668] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:18.937353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04561fe-37e1-402d-90fb-5cfd3ddca292 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:18.965079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:18.976669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ba80c-ddb7-43d8-95e4-f194662430fd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.013505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.014120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.014448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.014729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.015360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:19.015658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.017306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.027735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.030639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 339/669] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:19.031298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.064642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04561fe-37e1-402d-90fb-5cfd3ddca292 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.109155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.109766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.110042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.110343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.111133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=146b6b09371b4deb940ad1fb924ea984) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:19.111567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.113028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.120117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 331/670] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:18 2022] GET /identity/v3/role_assignments?user.id=146b6b09371b4deb940ad1fb924ea984&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:19.121412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.149916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170d36-f06b-44bb-b8d9-c721933c4c78 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.190692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9ca4-ce02-4c62-93b0-92cf39a6d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.191262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9ca4-ce02-4c62-93b0-92cf39a6d279 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.191544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9ca4-ce02-4c62-93b0-92cf39a6d279 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.191822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9ca4-ce02-4c62-93b0-92cf39a6d279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.204640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d9ca4-ce02-4c62-93b0-92cf39a6d279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e78d9ca4-ce02-4c62-93b0-92cf39a6d279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:19.211502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:19.213398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 340/671] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:19.215938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8abc-3f3d-4acd-8271-ec68415475ad None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.217418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8abc-3f3d-4acd-8271-ec68415475ad None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.217418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8abc-3f3d-4acd-8271-ec68415475ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.238181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e61b8abc-3f3d-4acd-8271-ec68415475ad None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:19.239456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e61b8abc-3f3d-4acd-8271-ec68415475ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:19.242731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.302315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c3422-3014-4f27-bbb9-c6d00da9ce7d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.337893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 341/672] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:19.338823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8abc-3f3d-4acd-8271-ec68415475ad None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.370176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.371663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.372147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.372619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.394683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.467479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.469366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.499438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8abc-3f3d-4acd-8271-ec68415475ad None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.538888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.539544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.539826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.540100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.547674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.549814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.552993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:19.563592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:19.565158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:19.566852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:19.570829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 342/673] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:19.571788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.600623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 332/674] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:19.601995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.655521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.704353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409adab-dfcb-4e09-ab93-641066081c86 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.742013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8f7b1-4cc9-4a8e-be71-ae6cbe0899bc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.758811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.759446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.759725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.760157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.760842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:19.761141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.762555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.774072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 343/675] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:19.775540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.794447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.796094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.796777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.797259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.798327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:19.798927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.800914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:19.816450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 333/676] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:19.817659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:19.869970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.925542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f7616-0df3-451a-8fb5-1622025915c3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.967011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:19.968576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:19.968913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:19.969518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:19.969518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:19.975889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888cb1d-3cfd-4c58-b93a-4e199cb5bf43 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:19.982118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:19.983630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:20.000027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:20.002924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:20.004654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:20.004654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:20.004654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:20.004654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 344/677] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:20.004654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.023537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.024190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.024472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.024746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.041283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:20.050835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:20.051882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:20.052750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 334/678] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:20.054430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.138888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaa3e3-44e1-4236-8042-caa7fc0e3fc3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.155245 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.179474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.180105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.180658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.180658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.193153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.194659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:20.210326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:20.211368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:20.217567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:20.217567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:20.217567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:20.217567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 345/679] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:20.217865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dc858-89a7-48a3-a799-d5cee898daf6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.217953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.264351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.264964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.265241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.265509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.266263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=916a9bae3ca94918af4efdfcae19d928) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.266587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.268579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.282270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 335/680] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/role_assignments?user.id=916a9bae3ca94918af4efdfcae19d928&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.282270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.328439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.400679 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7219-6e1f-4767-abab-aeb3f3286347 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.460039 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd4406-5da3-47b2-9a45-2c6ec66bd8a7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.468107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.469019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.469402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.469768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.471213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.471628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.473180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.496118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 346/681] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.497852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.507543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.508445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.508875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.509159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.509839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.510144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.511670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.522277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 336/682] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.523111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.553303 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.652463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.678677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62dbf0-a9f7-47f4-bc8c-be4d114650e9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.692965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d1be9-8ff3-4ceb-b0b6-3b652e565dbd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.729343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.730305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.730766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.731240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.741671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.743414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.758137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:20.758683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:20.759663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:20.760710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:20.761181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:20.761626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:20.762073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:20.763119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 337/683] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:20.763647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:20.764205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:20.764384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.766885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:20.790539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 347/684] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:20.791788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:20.934013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf3d9a-fef7-4db8-a49f-b3ab03f16fdd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:20.952100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:20.972591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae7dbd-fc4f-401f-97fc-a2481f7f836c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.013719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.014550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.014925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.015669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.016095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:21.016499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.018652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.026063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.028255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.028966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.029683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.034930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 348/685] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:21.036068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.059409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.063856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.071475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:21.087833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:21.089988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:21.091867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:21.091867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:21.091867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:21.091867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 338/686] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:21.093157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.265328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470abe8-c0c9-4c6f-a342-cbdad222c8a0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.333134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eedf0a-fc7a-4fde-b4cb-e10540af1c26 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.343176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.344522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.345857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.346428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.361719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.364650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:21.387959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:21.388969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:21.389891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:21.391131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 349/687] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:21.391201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.404278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a17a0-6da7-4c72-b021-b0852756f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.405276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a17a0-6da7-4c72-b021-b0852756f28e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.405786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a17a0-6da7-4c72-b021-b0852756f28e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.406291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a17a0-6da7-4c72-b021-b0852756f28e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.407306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a17a0-6da7-4c72-b021-b0852756f28e None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=43048122a82e4562babb240ff090d5f5) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:21.407847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a17a0-6da7-4c72-b021-b0852756f28e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.409962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a17a0-6da7-4c72-b021-b0852756f28e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.411251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.422939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 339/688] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/role_assignments?user.id=43048122a82e4562babb240ff090d5f5&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:21.425568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7de5-03c8-4a38-9467-f18a9f423224 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.426066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7de5-03c8-4a38-9467-f18a9f423224 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.426587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f7de5-03c8-4a38-9467-f18a9f423224 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.429238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 340/689] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:21.430605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7de5-03c8-4a38-9467-f18a9f423224 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.587853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.635979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8728df-6d40-4337-b4dd-dd0c78147da2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.660416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f7de5-03c8-4a38-9467-f18a9f423224 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:21.691195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a6787-0880-4631-beaf-5e0203268a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.692877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6787-0880-4631-beaf-5e0203268a96 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.693356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6787-0880-4631-beaf-5e0203268a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.693844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a6787-0880-4631-beaf-5e0203268a96 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.694739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a6787-0880-4631-beaf-5e0203268a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:21.695231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a6787-0880-4631-beaf-5e0203268a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.697184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a6787-0880-4631-beaf-5e0203268a96 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.721437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 350/690] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:21.725362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3559-7d32-4652-8b0f-9a262c9d5499 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.725854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3559-7d32-4652-8b0f-9a262c9d5499 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.726508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a3559-7d32-4652-8b0f-9a262c9d5499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.746279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:21.747457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:21.747939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:21.748480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:21.750086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:21.750727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:21.753855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:21.758752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1a3a3559-7d32-4652-8b0f-9a262c9d5499 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:21.760816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a3a3559-7d32-4652-8b0f-9a262c9d5499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:21.791106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 341/691] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:21.793456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:21.900357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:21.923433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 351/692] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:21.924708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3559-7d32-4652-8b0f-9a262c9d5499 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.065454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b9ae-7c77-4bf4-b5e6-8786ca709dd8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.103586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.144636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.145293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.145573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.145871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.160162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a3559-7d32-4652-8b0f-9a262c9d5499 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.163159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.164664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:22.182017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:22.183845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:22.185657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:22.191860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 342/693] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:22.207340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.228226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.228845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.229122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.229391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.361600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.380725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.384031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.399532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1e4ce-da1a-469c-be01-e661d0a3b72e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.485688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.486863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.487457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.487891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.489236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:22.489732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.492701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.519094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 343/694] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:22.520389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.567336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.594928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 352/695] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:22.597099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.655078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534eb76c-cb72-44fb-97d1-d19b1f9f8ddf None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.711360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.712460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.712952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.713551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.714611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.717366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:22.740630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:22.741884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:22.742801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:22.750379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 344/696] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:22.753125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:22.755878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.769467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126446ee-dd5b-4c90-8ba9-d9a43bd821d8 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.815749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19996a9c-f387-41b7-8059-1601f09ec992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.816592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996a9c-f387-41b7-8059-1601f09ec992 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.816981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996a9c-f387-41b7-8059-1601f09ec992 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.817369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19996a9c-f387-41b7-8059-1601f09ec992 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.898094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:22.902328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ec03f-97a8-42f1-bee9-d12663c7226a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:22.905461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19996a9c-f387-41b7-8059-1601f09ec992 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.906980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19996a9c-f387-41b7-8059-1601f09ec992 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.951394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:22.952676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:22.953004 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:22.953509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:22.971808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:22.973786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:22.990978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:22.992933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:22.994809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:22.994809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:22.994809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:22.994809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 345/697] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:22.994809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.040444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.062333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 353/698] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 08:02:23.065906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84c92-4a2d-4f38-b8c8-d9c19d99c8a2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.066777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84c92-4a2d-4f38-b8c8-d9c19d99c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.067599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84c92-4a2d-4f38-b8c8-d9c19d99c8a2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.077150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 354/699] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:23.079136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84c92-4a2d-4f38-b8c8-d9c19d99c8a2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.155188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfa022-ebeb-415d-a253-17e1c6683f49 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.224040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.225230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.225728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.226227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.227430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.228028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.230716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.235849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84c92-4a2d-4f38-b8c8-d9c19d99c8a2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.246392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 346/700] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.246392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.278710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.295977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f114443-c427-44ae-af70-77e598d2b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.297360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f114443-c427-44ae-af70-77e598d2b88b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.298114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f114443-c427-44ae-af70-77e598d2b88b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.298677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f114443-c427-44ae-af70-77e598d2b88b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.300187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f114443-c427-44ae-af70-77e598d2b88b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.300732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f114443-c427-44ae-af70-77e598d2b88b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.303371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f114443-c427-44ae-af70-77e598d2b88b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.331802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 355/701] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.331802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96899-ed4f-4523-97a6-0ddd5cd92aac None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.331802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96899-ed4f-4523-97a6-0ddd5cd92aac None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.331802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96899-ed4f-4523-97a6-0ddd5cd92aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.357304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-41a96899-ed4f-4523-97a6-0ddd5cd92aac None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:23.359048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-41a96899-ed4f-4523-97a6-0ddd5cd92aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:23.428358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.434931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54c165-bfb1-4b08-a735-9138bb7cc53f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.455404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 356/702] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:23.455404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96899-ed4f-4523-97a6-0ddd5cd92aac None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.526301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.527453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.529395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.529922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.554987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.559111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:23.601945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:23.603861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:23.605556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:23.605556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:23.605556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:23.611728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 347/703] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:23.613391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.695506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96899-ed4f-4523-97a6-0ddd5cd92aac None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.764380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.770567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.773618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.774479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.775227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.776699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:23.777492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.780189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.798962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 357/704] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:23.800954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:23.840587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a6924-ab81-49fd-b889-55485e637c6b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:23.924809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a43b17-ae3f-4751-8586-8c6d27f69681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:23.925474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43b17-ae3f-4751-8586-8c6d27f69681 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.925753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43b17-ae3f-4751-8586-8c6d27f69681 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.926031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a43b17-ae3f-4751-8586-8c6d27f69681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.935258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a43b17-ae3f-4751-8586-8c6d27f69681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:23.937465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a43b17-ae3f-4751-8586-8c6d27f69681 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:23.953800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c4a43b17-ae3f-4751-8586-8c6d27f69681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:23.955214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:23.956955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 348/705] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:23.959125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898673f-fb67-4a0b-a54e-49c5402400d9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.960187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898673f-fb67-4a0b-a54e-49c5402400d9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.960187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898673f-fb67-4a0b-a54e-49c5402400d9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.965939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 349/706] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:23.967482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a84ee-cdfb-46be-86ba-961879e13720 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:23.967809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a84ee-cdfb-46be-86ba-961879e13720 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:23.968639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a84ee-cdfb-46be-86ba-961879e13720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:23.996306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ea5a84ee-cdfb-46be-86ba-961879e13720 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:23.998370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ea5a84ee-cdfb-46be-86ba-961879e13720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:24.042026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d4dd2-8cd4-4c92-842a-0c8e5c0c699b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.094009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.095903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.096607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.097069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.099586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:24.099586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.101507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.127338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 358/707] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:24.130270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.132834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 350/708] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:24.134418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a84ee-cdfb-46be-86ba-961879e13720 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.277220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.361203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5a505-fb2e-4dad-b8c5-1b8fdf55610a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.370819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a84ee-cdfb-46be-86ba-961879e13720 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.385012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.436548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.437823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.438386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.439007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.450398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.451449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.451936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.453230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.455444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:24.456151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.460154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.462875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.469109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.489541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 351/709] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:24.489541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:24.511947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:24.512964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:24.513843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:24.513843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:24.513843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:24.522591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 359/710] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:24.524308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.670810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8bb8f-782e-4b40-88a2-2ae709ce93fc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.697530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.703064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0dc6a-61d6-46a5-9e09-6471069cf40b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.729338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.730456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.730931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.731408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.745101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.747834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.768774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:24.769823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:24.770277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:24.770774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:24.771624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:24.772535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:24.772946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] PATH_INFO: `/v3/services/network` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:24.772946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:24.774021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 352/711] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:24.774524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:24.774646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:24.796594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:24.797655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:24.799385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 360/712] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:24.800543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:24.850116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:24.962985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4f82a-80c1-4aac-bc75-c108fa94764b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:24.978111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94205f-bc6e-4ee5-8527-f2ca2062d56f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.015087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.015882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.016358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.016795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.017814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=3a545f5fde0d432fbe31819eb5c7c39d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.018464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.020277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.038283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 353/713] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/role_assignments?user.id=3a545f5fde0d432fbe31819eb5c7c39d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.038283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.058179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.060290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.060898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.061663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.063079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.063621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.067969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.106702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 361/714] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.107731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.119587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.239075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fbae3-b687-4f78-bb61-ad7b4834ccd6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.279991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.306585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.308113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.308984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.309697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.310996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.311518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.314783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.317829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952666c-68c6-4af1-b4f4-615767ec9e11 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.336496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 354/715] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.337922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.385544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.386776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.387323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.387871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.389547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] RBAC: Adding query filter params (name=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.390344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.393900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.402753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 362/716] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.404300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.550089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5e9a3-879b-45d1-bc19-45d3b59e7af0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.554123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:25.616006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892310f-6e29-4ec0-b4b4-48e620e4f82f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.643142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.644656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.645466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.646158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.647693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.650564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.691053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abd48b-7738-4179-9974-dcd1f59f40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.692296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd48b-7738-4179-9974-dcd1f59f40c4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.692987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd48b-7738-4179-9974-dcd1f59f40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:25.693566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abd48b-7738-4179-9974-dcd1f59f40c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:25.694667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 355/717] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:02:25 2022] POST /identity/v3/users => generated 254 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:25.696656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:25.699995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abd48b-7738-4179-9974-dcd1f59f40c4 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=631f5f7d18ab4574843a667ef17429ab) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:25.700922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abd48b-7738-4179-9974-dcd1f59f40c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:25.707627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abd48b-7738-4179-9974-dcd1f59f40c4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:25.737222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 363/718] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/role_assignments?user.id=631f5f7d18ab4574843a667ef17429ab&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:25.929249 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad2be-397e-4e3d-a2fc-454aaea9d0bb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:25.997380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfbe67-4831-4765-9bf3-81df580bda0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:25.998928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfbe67-4831-4765-9bf3-81df580bda0a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:25.999633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfbe67-4831-4765-9bf3-81df580bda0a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.000267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfbe67-4831-4765-9bf3-81df580bda0a None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.002264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfbe67-4831-4765-9bf3-81df580bda0a None admin] RBAC: Adding query filter params (type=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:26.003087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfbe67-4831-4765-9bf3-81df580bda0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.005906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfbe67-4831-4765-9bf3-81df580bda0a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:26.018030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 356/719] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:26.268570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38244f3-cb46-49ce-a352-cfc3f39386ad None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.269659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38244f3-cb46-49ce-a352-cfc3f39386ad None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.270159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38244f3-cb46-49ce-a352-cfc3f39386ad None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.271833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 364/720] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:26.277883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65a82-f3f2-4c36-b066-7486ebc8987c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.278644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65a82-f3f2-4c36-b066-7486ebc8987c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.279167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c65a82-f3f2-4c36-b066-7486ebc8987c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.305717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-38c65a82-f3f2-4c36-b066-7486ebc8987c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:26.307328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-38c65a82-f3f2-4c36-b066-7486ebc8987c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:26.331245 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:26.411633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 357/721] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:26.797115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38244f3-cb46-49ce-a352-cfc3f39386ad None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:26.820702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:26.948195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38244f3-cb46-49ce-a352-cfc3f39386ad None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:26.996653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a65c7-187c-4e13-a96a-3f1ea2cff0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:26.997278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a65c7-187c-4e13-a96a-3f1ea2cff0e3 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:26.997552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a65c7-187c-4e13-a96a-3f1ea2cff0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:26.997900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a65c7-187c-4e13-a96a-3f1ea2cff0e3 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:26.998519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a65c7-187c-4e13-a96a-3f1ea2cff0e3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:26.999922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a65c7-187c-4e13-a96a-3f1ea2cff0e3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:27.025491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 365/722] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:02:26 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:27.842840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae2f8-f418-4010-8759-e9d886e5ce5f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.843353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae2f8-f418-4010-8759-e9d886e5ce5f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.843467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae2f8-f418-4010-8759-e9d886e5ce5f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.845553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 358/723] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:27.851674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b668-5b10-45ee-80bd-5926e93d72dd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:27.852159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b668-5b10-45ee-80bd-5926e93d72dd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:27.852159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b668-5b10-45ee-80bd-5926e93d72dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:27.878417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ccb2b668-5b10-45ee-80bd-5926e93d72dd None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:27.879634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ccb2b668-5b10-45ee-80bd-5926e93d72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:27.978398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:27.985360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 366/724] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:28.345047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae2f8-f418-4010-8759-e9d886e5ce5f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.548994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae2f8-f418-4010-8759-e9d886e5ce5f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:28.627605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185ead5-1ea6-41e3-9c38-e42bb6a2aee2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.627871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185ead5-1ea6-41e3-9c38-e42bb6a2aee2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.628025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185ead5-1ea6-41e3-9c38-e42bb6a2aee2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.629715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 367/725] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:28.642835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105948-8d0f-42ab-9bbb-4a1f02cdfdc4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.643498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105948-8d0f-42ab-9bbb-4a1f02cdfdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.643991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105948-8d0f-42ab-9bbb-4a1f02cdfdc4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.644878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1f784-1fc3-41b7-a6ba-a67e08d6335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:28.645953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1f784-1fc3-41b7-a6ba-a67e08d6335b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.646362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 368/726] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:02:28.646468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1f784-1fc3-41b7-a6ba-a67e08d6335b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.650341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1f784-1fc3-41b7-a6ba-a67e08d6335b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.650521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139be52-d662-47e4-bf11-03ceb0568b76 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.650521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139be52-d662-47e4-bf11-03ceb0568b76 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.650521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139be52-d662-47e4-bf11-03ceb0568b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.668614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1f784-1fc3-41b7-a6ba-a67e08d6335b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-acd1f784-1fc3-41b7-a6ba-a67e08d6335b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:28.679321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:28.680428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:28.681416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:28.682090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c139be52-d662-47e4-bf11-03ceb0568b76 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:28.682177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 359/727] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:28.683522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c139be52-d662-47e4-bf11-03ceb0568b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:28.683765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc40b2-a3a1-4e1e-a5d7-9fa7e9dc06da None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.684461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc40b2-a3a1-4e1e-a5d7-9fa7e9dc06da None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.685161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc40b2-a3a1-4e1e-a5d7-9fa7e9dc06da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.716086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-62fc40b2-a3a1-4e1e-a5d7-9fa7e9dc06da None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:28.717596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-62fc40b2-a3a1-4e1e-a5d7-9fa7e9dc06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:28.729396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:28.769811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 369/728] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:28.770849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba76be-34ca-437e-ba8b-d07c8943b981 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.771169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba76be-34ca-437e-ba8b-d07c8943b981 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.771434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba76be-34ca-437e-ba8b-d07c8943b981 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.772892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 370/729] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:28.773339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba76be-34ca-437e-ba8b-d07c8943b981 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:28.834444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 360/730] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:28.836100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3955-e939-40f1-a7f6-12f735373997 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:28.836384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3955-e939-40f1-a7f6-12f735373997 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:28.837002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e3955-e939-40f1-a7f6-12f735373997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:28.904174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-857e3955-e939-40f1-a7f6-12f735373997 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:28.906290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-857e3955-e939-40f1-a7f6-12f735373997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:29.000951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba76be-34ca-437e-ba8b-d07c8943b981 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.037614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.045519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.046563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.047065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.047553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.049595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:29.056464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.059725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.077442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 361/731] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:28 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 08:02:29.078226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 371/732] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:29.091315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e3955-e939-40f1-a7f6-12f735373997 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.096004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.246120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.294452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e3955-e939-40f1-a7f6-12f735373997 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.326690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e83f-ba76-4974-9ff1-f15cec3f4383 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.364431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.365088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.365367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.365641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.375996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.379809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.380348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.380909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.381642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.382026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.383821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.387787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:29.404201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:29.406171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:29.408965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:29.408965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:29.408965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:29.408965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 362/733] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:29.409933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.425743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 372/734] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:02:29 2022] POST /identity/v3/services => generated 240 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:02:29.428586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.532334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.583113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28a8e5-162e-42da-8c25-cf18bd66ef6e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.633748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.634407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.634695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.634974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.635706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:29.636020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:29.638226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:29.660956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 373/735] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:29.662327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.664056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e312ef8-3a5c-44fe-811e-dafc14778ae2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.700791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.716933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.717604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.717889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.718164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.736814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:29.743343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:29.744526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 363/736] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:29.745328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:29.837786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839c12-b91c-409d-8e7c-3b72fe17dc89 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.870013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:29.906278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:29.907377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:29.908428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:29.908918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:29.922461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3176696-a979-4b7c-8cb0-ca7930d9d876 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:29.929344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:29.939385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:29.941174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 374/737] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:29.943483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.004058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.005758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.006566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.007270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.025129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.028566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:30.055080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:30.057294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:30.059402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:30.063230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 364/738] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:30.065262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.156415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727bed9-6b85-46a5-bf7e-b24a1d84a772 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.173737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.226399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.227093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.227377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.227663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.228816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:30.229321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.231771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.254313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 375/739] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:30.254313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.304195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4b847-60bb-468b-a4c3-d7ac135853df None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.314213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.365235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.366160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.366631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.367068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.368134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:30.368628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.370988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.386201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 365/740] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:30.387752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.473583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc66a3f-2374-4a12-bb87-784fc860226b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.541100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1606f-4763-4c06-895f-82c9dee71090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.542043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1606f-4763-4c06-895f-82c9dee71090 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.542805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1606f-4763-4c06-895f-82c9dee71090 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.543268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1606f-4763-4c06-895f-82c9dee71090 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.544554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1606f-4763-4c06-895f-82c9dee71090 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:30.545019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1606f-4763-4c06-895f-82c9dee71090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.549977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1606f-4763-4c06-895f-82c9dee71090 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.575460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a993cd-e2ce-42e4-918e-684374b9ee6f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.582210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 376/741] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:30.584365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1fc0a-a781-457f-af5f-0e2c80fbe227 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.584828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1fc0a-a781-457f-af5f-0e2c80fbe227 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.585279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1fc0a-a781-457f-af5f-0e2c80fbe227 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.594781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.598213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 377/742] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:30 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:30.599515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1fc0a-a781-457f-af5f-0e2c80fbe227 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.662398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.663375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.663836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.664291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.683746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.685911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:30.710897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:30.712738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:30.715085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:30.715085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.715085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:30.715085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 366/743] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:30.715085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.802144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:30.829971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1fc0a-a781-457f-af5f-0e2c80fbe227 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.844204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fcbdf-faac-44c9-b41f-fce6a8f6c499 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:30.889792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08127044-4c5a-4de0-b14c-2d8bea5135ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.890661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127044-4c5a-4de0-b14c-2d8bea5135ea None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.891006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127044-4c5a-4de0-b14c-2d8bea5135ea None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.891352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08127044-4c5a-4de0-b14c-2d8bea5135ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.898130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:30.899484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.900210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.900922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.905265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127044-4c5a-4de0-b14c-2d8bea5135ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.907202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08127044-4c5a-4de0-b14c-2d8bea5135ea None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.921849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:30.925139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-08127044-4c5a-4de0-b14c-2d8bea5135ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:30.926396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:30.928631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:30.930383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:30.930383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.930383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:30.935671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 367/744] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:30.937781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66c22-ca99-492f-bd93-2f7d96f4d41a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:30.938499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66c22-ca99-492f-bd93-2f7d96f4d41a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:30.939583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e66c22-ca99-492f-bd93-2f7d96f4d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:30.957128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:30.968447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:30.974308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:30.974308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:30.974308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:30.974308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 378/745] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:30.974308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:30.975321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-24e66c22-ca99-492f-bd93-2f7d96f4d41a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:30.975321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-24e66c22-ca99-492f-bd93-2f7d96f4d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:30.976841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.098479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 368/746] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:31.098479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66c22-ca99-492f-bd93-2f7d96f4d41a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.151929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ec0a6-f474-435d-86b2-0379a5c2605b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.228475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.229106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.229360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.233635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.233635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:31.233635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.233635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.245002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e66c22-ca99-492f-bd93-2f7d96f4d41a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.252483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.266438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 379/747] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:31.268341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.323177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.324200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.324698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.325190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.326443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:31.327002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.329752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.349803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.355278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 369/748] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:31.357038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.472075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631942-1c9a-4d99-9027-f597101a9737 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.523045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.523848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.524256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.524651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.525737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:31.526112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.527680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.544941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 380/749] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:31.548352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515912e3-c066-451b-92ee-a7cdb70829f2 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.554026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.594133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.594812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.597855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.598108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.613035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.615633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:31.640833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:31.643122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 370/750] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:31.645482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.660661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.728028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:31.737446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f447494-6049-4dbf-ac4c-efbb22ac2ddb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.780084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.780722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.780998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.781273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.791316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.793095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.805399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d6d2c-cf2b-424c-a816-2402ca0ea1d3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:31.807774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:31.809465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 381/751] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:31.812072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:31.856881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:31.857551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:31.857861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:31.858266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:31.859153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:31.861478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:31.877806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:31.879742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:31.880562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 371/752] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:31.882303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.020555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713de28-eb88-451a-b988-5a33e82f16a7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.057124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45dbe68-8f90-4b1a-ac93-f3b043545501 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.064109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.091176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.092238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.092725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.093213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.097797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.109167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.112657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.120919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.121933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.122536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.123029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.124358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:32.125336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.128778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:32.131470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:32.133260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 382/753] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:32.136208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.185761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 372/754] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Sep 1 08:02:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:32.185761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.282003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03477fa-c7da-48e2-a884-057c2154cef6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.328964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.330812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.331294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.331793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.333127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:32.333670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.336522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.359434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aaa980-b064-4faa-8576-8dcaa4168c35 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.360659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 383/755] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:32.361975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.412477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.413079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.413496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.413977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.415225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:32.415528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.418018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.427018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 373/756] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:32.428551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.439496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.512456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81161d64-43fc-4efb-9917-f36c4faeda60 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.526793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.565553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28961e6-f6f1-4ded-91a2-48cb3eec892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.566326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28961e6-f6f1-4ded-91a2-48cb3eec892a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.566674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28961e6-f6f1-4ded-91a2-48cb3eec892a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.567013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28961e6-f6f1-4ded-91a2-48cb3eec892a None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.567928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28961e6-f6f1-4ded-91a2-48cb3eec892a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:32.568410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28961e6-f6f1-4ded-91a2-48cb3eec892a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.570989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28961e6-f6f1-4ded-91a2-48cb3eec892a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.593241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 384/757] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:32.594609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f2d8-66a2-4912-baea-b829120c6309 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.594931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f2d8-66a2-4912-baea-b829120c6309 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.595305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f2d8-66a2-4912-baea-b829120c6309 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.601337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 385/758] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:32.601337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f2d8-66a2-4912-baea-b829120c6309 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.609811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660011a-3258-4eb0-9af8-7ad87e0ebd56 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.658085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.658792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.659141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.659472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.733125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.741896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.743142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f2d8-66a2-4912-baea-b829120c6309 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:32.743404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.786607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:32.787275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:32.787551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:32.787821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/3a545f5fde0d432fbe31819eb5c7c39d/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:32.789807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=3a545f5fde0d432fbe31819eb5c7c39d, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:32.791318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:32.810206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 386/759] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:32 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/3a545f5fde0d432fbe31819eb5c7c39d/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:32.810531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:32.811947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.891554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 374/760] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:02:32.893560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:32.962344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381fef-c190-47bc-8605-e169f3b048ef None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.013435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10750d5-4e8b-4e16-89c5-3e1f472d9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.014071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10750d5-4e8b-4e16-89c5-3e1f472d9011 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.014400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10750d5-4e8b-4e16-89c5-3e1f472d9011 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.014678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10750d5-4e8b-4e16-89c5-3e1f472d9011 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.015333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10750d5-4e8b-4e16-89c5-3e1f472d9011 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:33.015641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10750d5-4e8b-4e16-89c5-3e1f472d9011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.018072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10750d5-4e8b-4e16-89c5-3e1f472d9011 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.019719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fa433-b71f-4c8a-877c-604ec34559dd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.026575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 387/761] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:33.028124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a3f9a-1213-4cfa-a52e-bd1bdecacca2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.028573 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a3f9a-1213-4cfa-a52e-bd1bdecacca2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.029005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a3f9a-1213-4cfa-a52e-bd1bdecacca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.056260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-884a3f9a-1213-4cfa-a52e-bd1bdecacca2 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:33.058174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-884a3f9a-1213-4cfa-a52e-bd1bdecacca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:33.071976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.072906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.073306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.073750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.090388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.100967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.194804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 388/762] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:33.194804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a3f9a-1213-4cfa-a52e-bd1bdecacca2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.214655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.218199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.373720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a3f9a-1213-4cfa-a52e-bd1bdecacca2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.422326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 375/763] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:02:33.422326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.437668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.440765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.441530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.442308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.461740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.464493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.482130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:33.495973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:33.497175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:33.498387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:33.498387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.498387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:33.501835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 389/764] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:33.503092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.511724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.559526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb5cca-2ab3-467c-8143-5c1088a938dc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.608733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.609631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.610082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.611105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.612378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] RBAC: Adding query filter params (interface=public, service_id=00d91d9269764e87ad1e8880929e8346, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:33.612840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.614423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.624018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 376/765] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/endpoints?service_id=00d91d9269764e87ad1e8880929e8346&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:33.625229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.687208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57acbc-d4ff-4c4f-abbb-795809d0a590 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.739135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.739778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.740073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.740322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.744016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325f388-29d4-41b8-b09e-fed46ed43307 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.752826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.754361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.756617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:33.773732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:33.775614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:33.777397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:33.777397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:33.777397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:33.779328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 390/766] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:33.780954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.795991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.796610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.796895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.797143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.797806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:33.798309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.800182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:33.822055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 377/767] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:33.822055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:33.870137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:33.949722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f3cd3-c839-45b2-8f72-7f184d23570d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.953145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f0a8-ba5d-433d-8807-f6f5a19410bd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:33.992637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:33.993277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:33.993559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:33.993828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] PATH_INFO: `/v3/services/network` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:33.994498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:33.996013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:34.007293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:34.008328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:34.009155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 378/768] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:34.009933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.018397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.019446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.019922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.020405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.021518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.024096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.034456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 391/769] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:02:33 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.035959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.060970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.181317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61803b-362d-46ca-a489-51e411620917 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.245170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc901-f9c3-4491-9ef9-552e6c88335b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.254984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.255781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.256188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.256633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.257470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.257918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.259698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.275080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.283172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 379/770] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.284322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.305966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.307631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.308097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.308545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.324308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.326896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:34.353616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:34.354612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:34.355470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:34.356366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 392/771] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:34.357455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.471521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.479571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67926819-b697-4a54-bb3b-a0d2e8ae1f4d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.519842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.520470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.520747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.521093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.521750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] RBAC: Adding query filter params (name=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.522050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.523608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.534124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 380/772] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.535187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.545630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714bc57-6ea0-409d-ac40-fa6e431dd3ff None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.624990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.626632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.629069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.629808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.645355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.648315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.658766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6299a5-1d67-4626-90b8-640a563b8123 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:34.672524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:34.673979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:34.674893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:34.675315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 393/773] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:34.682299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.698693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.699314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.699591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.699866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.700578 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.700883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.702360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.716556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 381/774] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.717498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.738735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.770274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.831011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca2d0b-a6b1-4e4e-8b0f-fabdb23020fc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.872002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.873227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.873227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.873227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.873846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.874150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.875648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.889771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 382/775] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.890732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:34.899551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d9f54-eba5-4a86-8c9d-540f855bc36c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:34.966046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:34.967564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:34.968246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:34.968948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:34.970452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] RBAC: Adding query filter params (type=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:34.971194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:34.974055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:34.978780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:34.984945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 394/776] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:34.987820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.018420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8b79-b721-4d78-9cc2-991da1205633 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.066109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.066718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.066982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.067326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.068079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=5c37924aa7154c619adb78b69922b333) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:35.068387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.069837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.079828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 383/777] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/role_assignments?user.id=5c37924aa7154c619adb78b69922b333&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:35.088248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.121728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b6492-060a-4f3c-8163-01dd0cc97c5e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.125697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:35.196658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0741b0-6b44-432d-821e-0a18a9701a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.197908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0741b0-6b44-432d-821e-0a18a9701a03 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.198500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0741b0-6b44-432d-821e-0a18a9701a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.199034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0741b0-6b44-432d-821e-0a18a9701a03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.200054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0741b0-6b44-432d-821e-0a18a9701a03 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=631f5f7d18ab4574843a667ef17429ab) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:35.200981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0741b0-6b44-432d-821e-0a18a9701a03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.203739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0741b0-6b44-432d-821e-0a18a9701a03 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.213397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 395/778] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:34 2022] GET /identity/v3/role_assignments?user.id=631f5f7d18ab4574843a667ef17429ab&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:35.215109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a476a4-5829-45d4-9adb-e54dda99d8ca None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.215660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a476a4-5829-45d4-9adb-e54dda99d8ca None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.216115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a476a4-5829-45d4-9adb-e54dda99d8ca None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.218703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 396/779] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:35.229049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7aa3e-97bc-4d5d-a483-edc5d001c599 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.229883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7aa3e-97bc-4d5d-a483-edc5d001c599 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.231975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7aa3e-97bc-4d5d-a483-edc5d001c599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.273825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4fc7aa3e-97bc-4d5d-a483-edc5d001c599 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:35.276197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4251aea-a4d3-472e-a391-ac14bbe612d8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.277962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4fc7aa3e-97bc-4d5d-a483-edc5d001c599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:35.333750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.336749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.337274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.337769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.339125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] RBAC: Adding query filter params (interface=public, service_id=2fe68d8e25b346a5963d3d12de9b771a, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:35.339492 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.348554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.370210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 384/780] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/endpoints?service_id=2fe68d8e25b346a5963d3d12de9b771a&interface=public®ion_id=RegionOne => generated 194 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:35.382984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:35.399577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:35.454817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 397/781] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:35.563316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129f50a-ef16-49ad-822e-d06a1aa1890c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:35.632228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:35.633295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:35.633799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:35.634292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:35.635440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:35.637981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:35.649352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 385/782] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/services => generated 772 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:35.847121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7aa3e-97bc-4d5d-a483-edc5d001c599 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.027923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.036973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7aa3e-97bc-4d5d-a483-edc5d001c599 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.130933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.132022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.132528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.132886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.160929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:36.170823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:36.172633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:36.174728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 398/783] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:36.185511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.303922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.340219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf233-4b67-457c-9d16-21202b4f82b1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.380730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce35a7-16a4-41dd-9628-918c7eec9c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.381352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce35a7-16a4-41dd-9628-918c7eec9c7b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.381638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce35a7-16a4-41dd-9628-918c7eec9c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.381917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce35a7-16a4-41dd-9628-918c7eec9c7b None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.382651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce35a7-16a4-41dd-9628-918c7eec9c7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:36.382957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce35a7-16a4-41dd-9628-918c7eec9c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.384339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce35a7-16a4-41dd-9628-918c7eec9c7b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.394697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 386/784] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:36.408041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.449662 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f936c2-0d3a-494a-ba21-6baf5ea3d5d6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.449977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f936c2-0d3a-494a-ba21-6baf5ea3d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.450395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f936c2-0d3a-494a-ba21-6baf5ea3d5d6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.451905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 387/785] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:02:36.458537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b245d2-00fc-47d4-815e-db135d049451 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.458899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b245d2-00fc-47d4-815e-db135d049451 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.459114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b245d2-00fc-47d4-815e-db135d049451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.479651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-33b245d2-00fc-47d4-815e-db135d049451 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:36.480897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-33b245d2-00fc-47d4-815e-db135d049451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:36.557080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 388/786] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:36.663504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c095c-6b50-4cb5-8803-ff7c135ca281 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.717970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.719004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.719486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.720524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.737806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.739681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:36.766268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:36.767813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:36.768839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:36.768839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:36.768839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:36.771140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 399/787] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:36.778111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b245d2-00fc-47d4-815e-db135d049451 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.894873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:36.940800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b245d2-00fc-47d4-815e-db135d049451 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:36.967932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:36.986775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:36.987413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:36.987698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:36.987975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:36.988645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:36.988951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:36.990368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:36.997315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.020459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 389/788] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:37.025705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.140274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49346475-4ff8-4476-a03c-c14bb6f54f70 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.219557 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15637194-659c-4abe-9354-e4e3e7346622 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.246463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.260648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.261761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.262283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.262718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.271325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.272199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.272694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.273075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.274217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.274539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.276192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.276339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:37.293921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:37.295097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:02:37.296107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:37.298278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 390/789] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:37.306331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:37.307587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 08:02:37.308581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:37.310477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.322503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 400/790] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Sep 1 08:02:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:37.328412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.457585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.490480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66260-043c-47fc-ba3c-f14d2f4e3078 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.502951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bb7c6-e946-40dc-998d-94d73007cec5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.545129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.545772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.546057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.546364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.547154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:37.547469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.549392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.574053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 391/791] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:37.582496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.611732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.612735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.613227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.613742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.614539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:37.614948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.616475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.636670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 401/792] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:37.638768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.643474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:37.707912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e4f5b-5554-4ca1-b094-37b5297b0a85 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.757853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.758869 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.759216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.759592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.804988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbe3c1-c012-4d3a-96f0-b8cfbcefb2ae None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:37.842895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.845442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.847025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510464f6-a6ee-498c-b3bd-a4c8d5e4184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:37.848025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510464f6-a6ee-498c-b3bd-a4c8d5e4184e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.848499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510464f6-a6ee-498c-b3bd-a4c8d5e4184e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.848965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510464f6-a6ee-498c-b3bd-a4c8d5e4184e None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.849846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510464f6-a6ee-498c-b3bd-a4c8d5e4184e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:37.850468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510464f6-a6ee-498c-b3bd-a4c8d5e4184e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:37.853060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510464f6-a6ee-498c-b3bd-a4c8d5e4184e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:37.859685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 402/793] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:37.862065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a7c83-4e5f-4b35-aee0-8a17c8e0dbb9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.862637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a7c83-4e5f-4b35-aee0-8a17c8e0dbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.863260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a7c83-4e5f-4b35-aee0-8a17c8e0dbb9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.865165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 403/794] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:37.876999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f2cc-58e4-4eae-9126-031d7a63da6b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:37.877487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f2cc-58e4-4eae-9126-031d7a63da6b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:37.877943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f2cc-58e4-4eae-9126-031d7a63da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:37.888893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.903591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:37.917912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bd63f2cc-58e4-4eae-9126-031d7a63da6b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:37.920936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bd63f2cc-58e4-4eae-9126-031d7a63da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:37.975749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 392/795] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:02:37.976776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.068090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 404/796] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:38.069120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f2cc-58e4-4eae-9126-031d7a63da6b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.192729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f2cc-58e4-4eae-9126-031d7a63da6b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.230905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.234617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7456b-1e87-42c5-a5a5-9d7be917d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.236145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7456b-1e87-42c5-a5a5-9d7be917d478 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.236576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7456b-1e87-42c5-a5a5-9d7be917d478 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.237187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7456b-1e87-42c5-a5a5-9d7be917d478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.250287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7456b-1e87-42c5-a5a5-9d7be917d478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.251572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de9e5-5f78-4652-9ff1-d2d9250dabb6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.252398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7456b-1e87-42c5-a5a5-9d7be917d478 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-aaa7456b-1e87-42c5-a5a5-9d7be917d478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:38.270553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:38.271756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:38.272824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:38.272824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:38.272824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:38.274620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 405/797] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:38.278461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ced4-939e-461b-9926-991700f354b6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.279605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ced4-939e-461b-9926-991700f354b6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.280037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ced4-939e-461b-9926-991700f354b6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.281904 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 406/798] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:38.283438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ced4-939e-461b-9926-991700f354b6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.331534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be981b-345f-42a9-be9e-770213e57d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.332484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be981b-345f-42a9-be9e-770213e57d8d None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.332926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be981b-345f-42a9-be9e-770213e57d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.333401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be981b-345f-42a9-be9e-770213e57d8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.334770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be981b-345f-42a9-be9e-770213e57d8d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.337366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be981b-345f-42a9-be9e-770213e57d8d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.358949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.371383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 393/799] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:02:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:38.373433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da1a-9adc-41aa-b246-667ebf28484e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.374222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da1a-9adc-41aa-b246-667ebf28484e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.378460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80da1a-9adc-41aa-b246-667ebf28484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.409623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ee80da1a-9adc-41aa-b246-667ebf28484e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:38.411436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ee80da1a-9adc-41aa-b246-667ebf28484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:38.500207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ced4-939e-461b-9926-991700f354b6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.504821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 394/800] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:38.540993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80da1a-9adc-41aa-b246-667ebf28484e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.585865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.586493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.586785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.587055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.587725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:38.588027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.591902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.618327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 407/801] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:38.625029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.717290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.737540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80da1a-9adc-41aa-b246-667ebf28484e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.784417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:38.800708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1ac82-c288-49db-a8fe-b6d25c6bd1ef None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:38.802000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4173e-7d4e-41da-9e89-935143fbf1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.803329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4173e-7d4e-41da-9e89-935143fbf1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.804017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4173e-7d4e-41da-9e89-935143fbf1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.804624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4173e-7d4e-41da-9e89-935143fbf1d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.824482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4173e-7d4e-41da-9e89-935143fbf1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-15c4173e-7d4e-41da-9e89-935143fbf1d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:38.834810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:38.837018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:38.839460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:38.841824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 395/802] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:38.842542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167b51c-b96b-4e9f-88ae-f7257e0902d6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.842854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167b51c-b96b-4e9f-88ae-f7257e0902d6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.843085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167b51c-b96b-4e9f-88ae-f7257e0902d6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.845351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 396/803] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:38.852561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167b51c-b96b-4e9f-88ae-f7257e0902d6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:38.858397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36ae1d-f7de-446a-8942-df6d7663da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:38.860094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36ae1d-f7de-446a-8942-df6d7663da1c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.861449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36ae1d-f7de-446a-8942-df6d7663da1c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.862343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36ae1d-f7de-446a-8942-df6d7663da1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.875841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36ae1d-f7de-446a-8942-df6d7663da1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:38.879274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36ae1d-f7de-446a-8942-df6d7663da1c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-de36ae1d-f7de-446a-8942-df6d7663da1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:38.901414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:38.902390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:38.903267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:38.906585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 408/804] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:38.908329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c26bf-c114-4ad9-b2ce-b11c76d49069 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:38.908807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c26bf-c114-4ad9-b2ce-b11c76d49069 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:38.909280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c26bf-c114-4ad9-b2ce-b11c76d49069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:38.929226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fa4c26bf-c114-4ad9-b2ce-b11c76d49069 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:38.930471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fa4c26bf-c114-4ad9-b2ce-b11c76d49069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:39.006289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 409/805] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:39.006983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c26bf-c114-4ad9-b2ce-b11c76d49069 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.044571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.048270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167b51c-b96b-4e9f-88ae-f7257e0902d6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.098177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.099222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.099710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.100733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.101664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:39.102193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.104613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.117831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 397/806] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:39.119433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.134540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c26bf-c114-4ad9-b2ce-b11c76d49069 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.180779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.181441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.181723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.181997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.196349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:39.201696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:39.202716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:39.203994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 410/807] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:39.205213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.320859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.377119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279a94e-0fd4-4444-913c-67cde6bbcaa3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.396582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.409792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498518ca-7fd3-40a5-bf62-6294236e31e7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.440378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.441438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.441936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.442468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.443790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:39.444332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.447182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.453469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.454747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.455251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.455532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.468260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.470339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.477878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 398/808] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:39.477878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:39.497012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:39.498206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:39.499359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:39.499359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:39.499359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:39.499359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 411/809] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:39.499359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.629361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b744-ee8c-4054-8fc9-5114d9e15fb9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.674834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39447ff4-613d-45ad-8424-bc4026f9a8e6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.688351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.692163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.693489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.693949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.694648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.695626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.698514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:39.718785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:39.721440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:39.723768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 412/810] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:39.726959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.737884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.738736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.739139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.739579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.740412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:39.740835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.742900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:39.747611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:39.760951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 399/811] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:39.760951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:39.924357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475663dc-c641-4981-b03b-5a68d9017ed1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.953495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840b61d-1f7b-4e75-88a8-7e3f086b62f5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:39.985996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:39.987091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:39.987578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:39.988070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:39.989462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=3a545f5fde0d432fbe31819eb5c7c39d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:39.990003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:39.992743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.003928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 413/812] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/role_assignments?user.id=3a545f5fde0d432fbe31819eb5c7c39d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.005297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.033442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.035055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.035982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.036771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.038120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.038754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.041657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.067713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 400/813] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.069901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.132188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.153287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.225896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396af6c-f6d6-4c79-89d3-fbe6aa358b8c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.274145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397cbc-204a-4494-b7a3-81af6a9672c5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.274537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.275577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.276639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.277992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.279528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] RBAC: Adding query filter params (name=network) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.279662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.282750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.293945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 414/814] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.295997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.320015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.321560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.322319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.323037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.339354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.341135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:40.361009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:40.362865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:40.364486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:40.364486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:40.364486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:40.364486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 401/815] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:40.366202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.438099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47929b-6c12-4339-92e2-5de0ffa18beb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.477429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.477977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.478275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.478581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.492345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.494061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.494979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:40.513823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:40.515707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 415/816] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:40.518059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.525130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.562551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd8ade-7822-4206-9f51-e1a83d18809f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.643960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.643960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.643960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.643960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.644614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] RBAC: Adding query filter params (type=network) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.644614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.644862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.652116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 402/817] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.653215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.659695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbbf3-2e42-4e8a-86ac-d5d48bc03957 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.711743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.712485 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.712772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.713052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.713735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.714046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.715513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.731899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 416/818] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:40.732679 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.796446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:40.847922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6715d-d74f-49d6-8daa-0df8e6932040 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.850515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345476-a3ac-4806-87ed-11798b4569a7 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:40.895346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.895977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.896260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.896565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.897317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.898859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.920553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:40.921593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:40.922088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:40.923260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:40.924749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:40.925295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:40.927080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 417/819] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:02:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:40.928171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:40.933292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:40.990994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 403/820] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:41.000145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.006790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.064928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c365a-5c71-4f1d-95eb-3fde623d2f47 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.074630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.113915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4865ccbf-8ed2-4a98-a79b-3b21aaa50fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.115034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865ccbf-8ed2-4a98-a79b-3b21aaa50fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.115526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865ccbf-8ed2-4a98-a79b-3b21aaa50fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.116019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4865ccbf-8ed2-4a98-a79b-3b21aaa50fa6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.125522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865ccbf-8ed2-4a98-a79b-3b21aaa50fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.128668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4865ccbf-8ed2-4a98-a79b-3b21aaa50fa6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4865ccbf-8ed2-4a98-a79b-3b21aaa50fa6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:41.143256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:41.144345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:41.145298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:41.152864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 418/821] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:41.154765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f905-85b3-4924-b3ea-ed87b7b114f0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.155830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f905-85b3-4924-b3ea-ed87b7b114f0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.156333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0f905-85b3-4924-b3ea-ed87b7b114f0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.159776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 419/822] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:41.161186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f905-85b3-4924-b3ea-ed87b7b114f0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.218637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7c92-734d-4078-bf14-daf8667d68e1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.298986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794c16f-c538-4696-88b9-3851772623e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.300044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c16f-c538-4696-88b9-3851772623e2 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.300634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c16f-c538-4696-88b9-3851772623e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.300995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794c16f-c538-4696-88b9-3851772623e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.305716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0f905-85b3-4924-b3ea-ed87b7b114f0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.327440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c16f-c538-4696-88b9-3851772623e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.331067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794c16f-c538-4696-88b9-3851772623e2 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d794c16f-c538-4696-88b9-3851772623e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:41.352870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:41.353887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:41.354840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:41.354840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:41.354840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:41.356367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 404/823] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:41.357929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212b2e-4208-47a9-aa60-756e46698770 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.358660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212b2e-4208-47a9-aa60-756e46698770 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.359070 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a212b2e-4208-47a9-aa60-756e46698770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.365189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.366226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.367111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.368281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.374141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:41.374141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.375420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.397604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1a212b2e-4208-47a9-aa60-756e46698770 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:41.399798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1a212b2e-4208-47a9-aa60-756e46698770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:41.412315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 420/824] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:41.417085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.462888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.490440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.522230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 405/825] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:41.523597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212b2e-4208-47a9-aa60-756e46698770 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.572510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db6864-e071-413c-81ad-ed6b48a8f671 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.630965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.630965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.631406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.631549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.632194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:41.632501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.633902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.648486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 421/826] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:41.653718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.761360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a212b2e-4208-47a9-aa60-756e46698770 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.798737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.806695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.806972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.807339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.807610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.813959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52413e-a015-4d5e-96ad-ab8c000c479b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:41.820798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.822644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:41.839855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:41.840881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:41.847518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:41.847518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:41.847518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:41.847518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 406/827] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:41.847518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.879991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:41.880663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:41.880951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:41.881236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:41.890520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:41.892798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:41.902259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:41.913008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:41.913999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:41.914912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 422/828] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:41.915388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:41.984929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e7399-2809-453c-8bb6-a55999e7241f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.023968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.024620 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.024899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.025175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.025764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.027182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:42.037289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:42.038626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:42.040124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 407/829] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:42.040918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.049708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6143b-4e00-4efb-ab84-82896ec2e453 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.097942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.098761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.099239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.099626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.100361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.100699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.102575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.119216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 423/830] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.120143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.129468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.218608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85197d-ab44-4191-a3aa-56a813add12d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.223558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.281044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.281719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.282146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.282632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.283588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.283901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.285540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.308497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 408/831] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.308497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.327455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392477b8-f390-4840-8e9f-9c79e7f959aa None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.383152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.384092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.384092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.384376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.384834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.385136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.386646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.393303 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 424/832] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.398741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.474382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd2d7-59fe-4ae3-bfcb-f439b396d20b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.513976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.527790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.528772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.529218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.529665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.542629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.545939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:42.571129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:42.572728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:42.574356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:42.578606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 409/833] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:42.581496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.589445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a562ec-f161-4fa5-8c93-7b6fa0efaa42 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.637405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.650884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.651817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.652271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.652703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/631f5f7d18ab4574843a667ef17429ab/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.654983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=631f5f7d18ab4574843a667ef17429ab, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.656770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.678123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 425/834] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:42 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/631f5f7d18ab4574843a667ef17429ab/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:02:42.687500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:42.816784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb660f1-e6e5-42c9-bb32-23f55ea21088 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.891266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ca52-464f-46c1-ac84-2d209a5f4353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.892925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ca52-464f-46c1-ac84-2d209a5f4353 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.892925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ca52-464f-46c1-ac84-2d209a5f4353 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.893225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ca52-464f-46c1-ac84-2d209a5f4353 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.894441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ca52-464f-46c1-ac84-2d209a5f4353 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.894963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ca52-464f-46c1-ac84-2d209a5f4353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.897648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ca52-464f-46c1-ac84-2d209a5f4353 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.906020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 410/835] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.908034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53c46a-7952-483d-a63f-03f1218c3819 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:42.909198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c6fb-993e-4206-937b-f83a6661b8dc None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.909336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c6fb-993e-4206-937b-f83a6661b8dc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.909815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3c6fb-993e-4206-937b-f83a6661b8dc None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.916705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 411/836] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:42.919380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db5f9-3d32-4118-8350-42e294dd76d6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.919843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db5f9-3d32-4118-8350-42e294dd76d6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.920326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db5f9-3d32-4118-8350-42e294dd76d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.950288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:42.957159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9e5db5f9-3d32-4118-8350-42e294dd76d6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:42.960129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9e5db5f9-3d32-4118-8350-42e294dd76d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:42.962278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:42.963224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:42.963909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:42.964201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:42.965177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:42.965557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:42.967516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:42.983837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 426/837] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:42.990972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.090282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 412/838] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:43.199592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9d804-7c38-4895-988e-d7a5a88ca50d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.265822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.267028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.267619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.268114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/5c37924aa7154c619adb78b69922b333/roles/cb1108a3a43e41cb83124569db481d4a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.296752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=5c37924aa7154c619adb78b69922b333, role_id=cb1108a3a43e41cb83124569db481d4a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.300181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.325935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 427/839] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:02:42 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/5c37924aa7154c619adb78b69922b333/roles/cb1108a3a43e41cb83124569db481d4a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:02:43.457754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db5f9-3d32-4118-8350-42e294dd76d6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.494077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.636170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db5f9-3d32-4118-8350-42e294dd76d6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.679664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.680616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.681078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.681558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.682388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.683954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:43.693830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:43.694841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:43.695717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:43.698095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 413/840] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Sep 1 08:02:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:43.704304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.751551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.819439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8641be-393b-4cb5-92bc-95c2a1839f32 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:43.856983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31760d-87d9-4198-a534-a51e8213db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:43.857606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31760d-87d9-4198-a534-a51e8213db82 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:43.858499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31760d-87d9-4198-a534-a51e8213db82 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:43.858773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31760d-87d9-4198-a534-a51e8213db82 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:43.859419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31760d-87d9-4198-a534-a51e8213db82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:43.859717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31760d-87d9-4198-a534-a51e8213db82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:43.861717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31760d-87d9-4198-a534-a51e8213db82 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:43.867313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 428/841] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:43.872996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:43.973871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:43.996669 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679168-6d95-4d11-ad74-2af03ebfc9a3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:44.038642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61942881-137f-479d-aa10-ff1deb423620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:44.039268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61942881-137f-479d-aa10-ff1deb423620 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:44.039550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61942881-137f-479d-aa10-ff1deb423620 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:44.039823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61942881-137f-479d-aa10-ff1deb423620 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:44.040484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61942881-137f-479d-aa10-ff1deb423620 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:44.040787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61942881-137f-479d-aa10-ff1deb423620 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:44.042204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61942881-137f-479d-aa10-ff1deb423620 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:44.048746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 414/842] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:45.190020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aab43-d56d-466b-a52e-092bf9ec54bb None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.190625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aab43-d56d-466b-a52e-092bf9ec54bb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.190625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aab43-d56d-466b-a52e-092bf9ec54bb None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.192129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 429/843] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:45.198038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0d8d-2ce9-40fa-bfd6-87f5cded230e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.198581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0d8d-2ce9-40fa-bfd6-87f5cded230e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.198581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a0d8d-2ce9-40fa-bfd6-87f5cded230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.219254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-892a0d8d-2ce9-40fa-bfd6-87f5cded230e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:45.220832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-892a0d8d-2ce9-40fa-bfd6-87f5cded230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:45.302885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 415/844] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:45.582818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aab43-d56d-466b-a52e-092bf9ec54bb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:45.721026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aab43-d56d-466b-a52e-092bf9ec54bb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:45.723231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:45.763051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98162ddb-cc38-4637-afa8-8eaf3cbaab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:45.763675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98162ddb-cc38-4637-afa8-8eaf3cbaab26 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.763953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98162ddb-cc38-4637-afa8-8eaf3cbaab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.764226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98162ddb-cc38-4637-afa8-8eaf3cbaab26 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.764906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98162ddb-cc38-4637-afa8-8eaf3cbaab26 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:45.766591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98162ddb-cc38-4637-afa8-8eaf3cbaab26 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:45.778108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8a6ee-e0f6-44d6-8d0a-2d61e6b93cfd None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.778389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8a6ee-e0f6-44d6-8d0a-2d61e6b93cfd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.778774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8a6ee-e0f6-44d6-8d0a-2d61e6b93cfd None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.780412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 416/845] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:45.790510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f49cf2-2c5c-4337-b677-3be9c2e1d718 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:45.791107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 430/846] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:02:45 2022] POST /identity/v3/services => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:45.791788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f49cf2-2c5c-4337-b677-3be9c2e1d718 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:45.792486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f49cf2-2c5c-4337-b677-3be9c2e1d718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:45.825844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a7f49cf2-2c5c-4337-b677-3be9c2e1d718 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:45.827899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a7f49cf2-2c5c-4337-b677-3be9c2e1d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:45.928706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:45.936186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 417/847] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:46.162616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9cf68-4099-4a1a-9b72-a945ae779eda None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.163113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9cf68-4099-4a1a-9b72-a945ae779eda None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.163589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9cf68-4099-4a1a-9b72-a945ae779eda None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.166280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 431/848] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:46.175899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0557eb-00fe-4ca6-8566-4c2baa9decd7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.176378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0557eb-00fe-4ca6-8566-4c2baa9decd7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.176867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0557eb-00fe-4ca6-8566-4c2baa9decd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.195226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0366433-dda6-4834-972e-b86273005dc3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.196285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0366433-dda6-4834-972e-b86273005dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.196774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0366433-dda6-4834-972e-b86273005dc3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.198665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 432/849] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:02:46.204556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47957-5493-4d6f-b4d3-5d884bdbdc91 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.205193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47957-5493-4d6f-b4d3-5d884bdbdc91 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.205693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e47957-5493-4d6f-b4d3-5d884bdbdc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.205989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dc0557eb-00fe-4ca6-8566-4c2baa9decd7 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:46.207305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dc0557eb-00fe-4ca6-8566-4c2baa9decd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:46.226292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c9e47957-5493-4d6f-b4d3-5d884bdbdc91 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:46.227896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c9e47957-5493-4d6f-b4d3-5d884bdbdc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:46.294391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 418/850] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:46.295690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0557eb-00fe-4ca6-8566-4c2baa9decd7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:46.336205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 433/851] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:46.427531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0557eb-00fe-4ca6-8566-4c2baa9decd7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:46.463419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:46.470660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:46.471722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.472187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.472642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.484536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:46.490397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:46.491394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:02:46.492221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:46.494626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 419/852] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:46.504422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47957-5493-4d6f-b4d3-5d884bdbdc91 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:46.615031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:46.634654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:46.638697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e47957-5493-4d6f-b4d3-5d884bdbdc91 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:46.725417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:46.726907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.727829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.728392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.729655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:46.730205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:46.734437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:46.746596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 434/853] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:46.747475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:46.771631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24c4cc-1e3d-4da3-a951-3ebddf853ffe None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:46.816578 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:46.817528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.817914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.818393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.819493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:46.821864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:46.850533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 420/854] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:02:46 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:02:46.852113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:46.889355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84adeeb-645e-4058-9207-90d9159a9e5e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:46.940487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:46.941512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:46.942028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:46.942535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:46.959725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:46.965962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:46.967067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:02:46.967915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:46.971008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 435/855] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:46.979011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:46.985769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.014634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:47.050725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93b75-ace1-47a1-bbbc-4fb23afcee04 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:47.100617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:47.101595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.101943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.102337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.116724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:47.117737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:47.162583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:47.164485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:47.166205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:47.166205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:47.166205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:47.169753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 421/856] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:47.181514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f5eb6b-984a-4f1b-99e0-a2a3cf8faadd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:47.183635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.230304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:47.233699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.234522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.236002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.238560 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:47.239726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:47.244710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:47.277112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 436/857] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:47.278893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.348808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dd01f-3287-4363-8b13-0f22f5fc975e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:47.352922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:47.419597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:47.420891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.421541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.422172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.424842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:47.426516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:47.428390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:47.451181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 422/858] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:47.462820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.570095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:47.615311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cad46-05ed-41c4-abef-0b27f35bce04 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:47.635831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37997d-8008-4b1e-a42a-72995543783d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:47.654882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:47.655934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.656360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.656817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.669161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:47.671152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:47.688024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:47.689611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:47.690564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:47.690564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:47.690564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:47.692633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 437/859] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:47.702667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.709137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:47.710378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.710948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.711531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.726478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:47.729480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:47.755400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:47.756457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 08:02:47.757390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:47.767397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 423/860] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:02:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:47.769205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.815883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:47.829839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150225d-cfab-4c52-9506-5f023f91d884 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:47.859716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:47.874555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:47.875509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:47.876051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:47.876742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:47.877579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:47.878169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:47.879903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:47.894452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 438/861] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:47.903954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:47.953012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1a3c9-e904-426d-a38d-818201339a7b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:47.999785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.000424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.001284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.001720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.002819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:48.003128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.004828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.031412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 424/862] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Sep 1 08:02:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:48.037939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.080251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d906438-0dcb-4a6c-83e6-867f5117e3a4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.125403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.126682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.126964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.127238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.137814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.139572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.140626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:48.155763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:48.157308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:48.158233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 439/863] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:02:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:48.164270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.171073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943c548-bdac-40fb-8c95-b2983cf57007 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.218279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.218898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.219184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.219491 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.220845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.296120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a5a17-77b5-4b37-be41-1c8ad8bb3a46 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.319176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.321007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.342749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.343745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.344341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.344818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.345998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:48.346608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.348503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.374987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 440/864] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:48.376938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.428894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.461130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 425/865] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:02:48.463338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.503838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32d702-3029-4e9e-8992-fb59c0bb2c67 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.505841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.546283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.547397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.547885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.548628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.598940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d43a2e-b1b4-449d-a4c1-256a7dc5fc32 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.648104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.651036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.651365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.651649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.651924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.652194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.666971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.668967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:48.692077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:48.693084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:48.693969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:48.693969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:48.693969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:48.698308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 426/866] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:48.700196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.746334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.788658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 441/867] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:02:48.790116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.792590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:48.842554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f732d-7ebb-4ce8-b10c-efed5bb4644b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.891813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.892439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.892722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.892994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.893659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:48.894139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.896071 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:48.914339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 427/868] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:48.919298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:48.923568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56429c58-b930-4c7f-96d3-020d4d10da86 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:48.968489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29feb30-b17f-4284-80c1-ddb3a2b69df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:48.969712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29feb30-b17f-4284-80c1-ddb3a2b69df0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:48.969999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29feb30-b17f-4284-80c1-ddb3a2b69df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:48.970297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29feb30-b17f-4284-80c1-ddb3a2b69df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:48.984297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29feb30-b17f-4284-80c1-ddb3a2b69df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:48.986345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29feb30-b17f-4284-80c1-ddb3a2b69df0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a29feb30-b17f-4284-80c1-ddb3a2b69df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:49.002356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.003383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:49.004271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:49.004271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:49.004271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:49.004271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 442/869] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:49.004915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ace26-a844-4164-acd2-d3ff789c310f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.005114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ace26-a844-4164-acd2-d3ff789c310f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.005393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ace26-a844-4164-acd2-d3ff789c310f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.007163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 443/870] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:49.012394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397358-eb24-4515-b70c-4abaa5ca0ad6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.012674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397358-eb24-4515-b70c-4abaa5ca0ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.012945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6397358-eb24-4515-b70c-4abaa5ca0ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.032649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d6397358-eb24-4515-b70c-4abaa5ca0ad6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:49.033882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6397358-eb24-4515-b70c-4abaa5ca0ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:49.044826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.055821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced42b55-aa1f-48bf-b471-036f53f54fad None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.090741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.096152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.096808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.097091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.097367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.104801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.106299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.110994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 444/871] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:49.112142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6397358-eb24-4515-b70c-4abaa5ca0ad6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:49.120767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.121712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:49.122631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:49.126830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 428/872] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:49.129196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.263301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6397358-eb24-4515-b70c-4abaa5ca0ad6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.268213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f11e8-393b-472a-b8c0-1b441402b6c1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.304952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e81957-ae04-4673-9d73-f4aa9ebb173a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.305571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81957-ae04-4673-9d73-f4aa9ebb173a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.305855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81957-ae04-4673-9d73-f4aa9ebb173a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.306130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e81957-ae04-4673-9d73-f4aa9ebb173a None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.306880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81957-ae04-4673-9d73-f4aa9ebb173a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:49.307201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81957-ae04-4673-9d73-f4aa9ebb173a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.308760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e81957-ae04-4673-9d73-f4aa9ebb173a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.321821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 429/873] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:49.323136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376090-0909-484f-87b4-d88655d51ce1 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.323449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376090-0909-484f-87b4-d88655d51ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.323701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c376090-0909-484f-87b4-d88655d51ce1 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.325184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 430/874] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:49.328339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376090-0909-484f-87b4-d88655d51ce1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.339538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0ffb0d-4b27-48d6-be5a-bf43626545f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.340354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ffb0d-4b27-48d6-be5a-bf43626545f5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.340557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ffb0d-4b27-48d6-be5a-bf43626545f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.340706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ffb0d-4b27-48d6-be5a-bf43626545f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.341744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ffb0d-4b27-48d6-be5a-bf43626545f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:49.342042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ffb0d-4b27-48d6-be5a-bf43626545f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.343835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0ffb0d-4b27-48d6-be5a-bf43626545f5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.346592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.360638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 445/875] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:49.366413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502852-1038-481d-8cb0-0bdbae5438ee None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.366906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502852-1038-481d-8cb0-0bdbae5438ee None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.367067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502852-1038-481d-8cb0-0bdbae5438ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.388907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-66502852-1038-481d-8cb0-0bdbae5438ee None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:49.390233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-66502852-1038-481d-8cb0-0bdbae5438ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:49.436057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.450678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c376090-0909-484f-87b4-d88655d51ce1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.472608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 446/876] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:49.473481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502852-1038-481d-8cb0-0bdbae5438ee None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.508143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.508763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.509199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.509358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.510512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=631f5f7d18ab4574843a667ef17429ab) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:49.510512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.511943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.530478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 431/877] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/role_assignments?user.id=631f5f7d18ab4574843a667ef17429ab&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:49.530478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.653770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.655631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502852-1038-481d-8cb0-0bdbae5438ee None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.690156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303ecc9-fc31-4132-af3c-59aad9509ee5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.730951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390b252-c796-472f-8e53-22371a96811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.733118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390b252-c796-472f-8e53-22371a96811e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.734380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390b252-c796-472f-8e53-22371a96811e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.734932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390b252-c796-472f-8e53-22371a96811e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.746091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.746393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390b252-c796-472f-8e53-22371a96811e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.746784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.747061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.747331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.747898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390b252-c796-472f-8e53-22371a96811e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.748009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.749267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.760836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.761855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:49.762706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 432/878] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e390b252-c796-472f-8e53-22371a96811e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:49.764170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:49.765028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:49.765872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:49.768077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.771454 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 447/879] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:49.772319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390b252-c796-472f-8e53-22371a96811e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.813203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:49.896021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390b252-c796-472f-8e53-22371a96811e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.931515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf7f5-943e-4097-80cd-ffe1c89e6f3a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:49.936231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.936856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.937138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.937411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.938659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:49.939602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.941006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.950875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 448/880] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:49.950875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:49.984060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:49.985422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:49.985792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:49.986166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:49.986862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:49.988273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:49.998014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:50.000161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:50.002799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 433/881] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:50.004299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.013156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.133055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.139351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6d4d-a655-4ea4-b95b-918bcd177b0b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.159639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1191c-1f5b-437a-8100-2f9fd2a83ce0 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.196133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.197090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.197587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.198026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.199271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.199770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.202097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.216679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.217638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.218077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.218547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.219659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.220210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.222538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.225063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 449/882] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.226523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.234702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 434/883] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.236624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.326369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.387561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a34e85-7e32-41a6-9e98-7f1b6c8557e1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.389386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fec291-f93b-4070-906c-507c65a537b6 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.432723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.433516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.433790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.434059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.434729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.435023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.436407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.442358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 450/884] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.443193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.452975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.454385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.454653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.454920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.455670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=5c37924aa7154c619adb78b69922b333) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.455973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.457563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.464314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 435/885] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/role_assignments?user.id=5c37924aa7154c619adb78b69922b333&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.465160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.509432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.644253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f17da-cf2b-4db1-a0e6-cf29edced88a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.691884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b94b8a-b5a5-4e03-8355-f3521f69c398 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.700523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.705356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.706200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.706705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.707376 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.707721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.708029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.709866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.715882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 436/886] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.722091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.739131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.739998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.740405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.740802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.741663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] RBAC: Adding query filter params (interface=public, service_id=460961e7ac3b4c59a00e4f7c5ac610bb, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.742141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.743715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.752651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 451/887] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/endpoints?service_id=460961e7ac3b4c59a00e4f7c5ac610bb&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:50.763373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.883610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbed7-fdce-4f62-b8f9-f97bad0c951b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.901393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:50.919436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453e23-8a7c-409c-ba74-91d31b67d132 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:50.942708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.943464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.943815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.944157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.944958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] RBAC: Adding query filter params (interface=public, service_id=cce5445f07fe4eb4a85f469050839ede, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:50.945345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.946895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.960395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 437/888] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/endpoints?service_id=cce5445f07fe4eb4a85f469050839ede&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:50.962627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:50.974335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdc5fe-6e2a-41f5-8a53-7367c32f974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:50.975458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdc5fe-6e2a-41f5-8a53-7367c32f974f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:50.975963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdc5fe-6e2a-41f5-8a53-7367c32f974f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:50.976452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdc5fe-6e2a-41f5-8a53-7367c32f974f None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:50.977630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdc5fe-6e2a-41f5-8a53-7367c32f974f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:50.981373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bdc5fe-6e2a-41f5-8a53-7367c32f974f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:50.997224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 452/889] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/services => generated 1268 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:02:51.063760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:51.115084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160a80-ecc8-4b1a-8048-f8319026ac9d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:51.155787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1bb4d-0a17-478e-ab4a-b0290c3d82ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:51.156326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bb4d-0a17-478e-ab4a-b0290c3d82ac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.156650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bb4d-0a17-478e-ab4a-b0290c3d82ac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.156934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bb4d-0a17-478e-ab4a-b0290c3d82ac None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.157553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1bb4d-0a17-478e-ab4a-b0290c3d82ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:51.159132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1bb4d-0a17-478e-ab4a-b0290c3d82ac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:51.166170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 438/890] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:02:50 2022] GET /identity/v3/services => generated 1268 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:02:51.778005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c358c-6033-4a4a-8ec1-96c1252e2543 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.778759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c358c-6033-4a4a-8ec1-96c1252e2543 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.778759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c358c-6033-4a4a-8ec1-96c1252e2543 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.780228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 453/891] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:02:51.787083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d1546-a489-4d11-be67-49de2aca4bfe None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:51.787678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d1546-a489-4d11-be67-49de2aca4bfe None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:51.787678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d1546-a489-4d11-be67-49de2aca4bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:51.815306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-791d1546-a489-4d11-be67-49de2aca4bfe None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:51.817364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-791d1546-a489-4d11-be67-49de2aca4bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:51.949092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 439/892] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:52.245554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c358c-6033-4a4a-8ec1-96c1252e2543 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.396358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c358c-6033-4a4a-8ec1-96c1252e2543 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.462756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.463833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.464327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.464809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.465855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.468519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:52.489335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:52.493179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:52.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 454/893] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:52.506613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d1546-a489-4d11-be67-49de2aca4bfe None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.613190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:52.675339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d1546-a489-4d11-be67-49de2aca4bfe None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.728827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a62c7a-5aa8-4101-a49a-3a31454cf3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.730028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62c7a-5aa8-4101-a49a-3a31454cf3df None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.730728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62c7a-5aa8-4101-a49a-3a31454cf3df None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.731255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62c7a-5aa8-4101-a49a-3a31454cf3df None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.732447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a62c7a-5aa8-4101-a49a-3a31454cf3df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:52.733318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a62c7a-5aa8-4101-a49a-3a31454cf3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.738580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a62c7a-5aa8-4101-a49a-3a31454cf3df None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.746653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 440/894] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:52.757411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:52.784657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:52.930784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6f3d-bd87-432d-be92-6d11c46687cb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:52.969083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f11b83-1d40-43f6-be11-44701518a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:52.970305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11b83-1d40-43f6-be11-44701518a0ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:52.970656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11b83-1d40-43f6-be11-44701518a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:52.970915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f11b83-1d40-43f6-be11-44701518a0ea None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:52.971545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f11b83-1d40-43f6-be11-44701518a0ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:52.971849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f11b83-1d40-43f6-be11-44701518a0ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:52.973244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f11b83-1d40-43f6-be11-44701518a0ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:52.978840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 455/895] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:02:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:53.020145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bdb7f-0073-4ec9-bc80-0a9c97073183 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.020951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bdb7f-0073-4ec9-bc80-0a9c97073183 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.020951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4bdb7f-0073-4ec9-bc80-0a9c97073183 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.022586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 441/896] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:02:53.028408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383443b-0502-42bb-949d-f73aef898850 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.028782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383443b-0502-42bb-949d-f73aef898850 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.029007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383443b-0502-42bb-949d-f73aef898850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.050332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9383443b-0502-42bb-949d-f73aef898850 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:53.051630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9383443b-0502-42bb-949d-f73aef898850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:53.137878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 456/897] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:53.312133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae15f-7cd3-48bf-b736-3d51168d7eed None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.312490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae15f-7cd3-48bf-b736-3d51168d7eed None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.312668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aae15f-7cd3-48bf-b736-3d51168d7eed None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.314351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 442/898] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:53.320786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37a674-e97f-4e2a-b226-419b8a40d309 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.320786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37a674-e97f-4e2a-b226-419b8a40d309 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.320786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37a674-e97f-4e2a-b226-419b8a40d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.341353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dc37a674-e97f-4e2a-b226-419b8a40d309 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:53.342979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dc37a674-e97f-4e2a-b226-419b8a40d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:53.346093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.414254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aae15f-7cd3-48bf-b736-3d51168d7eed None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.421757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 457/899] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:02:53.551114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aae15f-7cd3-48bf-b736-3d51168d7eed None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.585810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.611883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.612651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.613030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.613396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.627221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:53.632319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:53.633333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:53.634442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 443/900] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:53.642299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37a674-e97f-4e2a-b226-419b8a40d309 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.736260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.761650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37a674-e97f-4e2a-b226-419b8a40d309 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.804749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.806335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.806953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.807452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.808351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:53.808888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.810697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.817302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:53.826515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 458/901] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:53.828149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.862735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b2818-2d16-4aac-a26a-f99c37428c4f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:53.906115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:53.907625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:53.907625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:53.908489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:53.908864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:53.910308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:53.920495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:53.922143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 08:02:53.925529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:53.928238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 444/902] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:53.928915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:53.984234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513495c1-3775-4745-aa04-38d0a8ac0216 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.004263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.056997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098c40e-570a-4891-9022-dac85cea9697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.058058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c40e-570a-4891-9022-dac85cea9697 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.058545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c40e-570a-4891-9022-dac85cea9697 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.058927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098c40e-570a-4891-9022-dac85cea9697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.082562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098c40e-570a-4891-9022-dac85cea9697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.085487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098c40e-570a-4891-9022-dac85cea9697 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.096043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d30f-35ca-4b09-b8d1-bd699c6c5f75 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7098c40e-570a-4891-9022-dac85cea9697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:54.115857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:54.117719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:54.119142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:54.119142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:54.119142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:54.119142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 459/903] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:54.120178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0aed-4df2-4c7b-b310-843b027faad9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.120673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0aed-4df2-4c7b-b310-843b027faad9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.121130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f0aed-4df2-4c7b-b310-843b027faad9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.124357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 460/904] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:54.128412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f0aed-4df2-4c7b-b310-843b027faad9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.153516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19e341-a15b-4050-9986-f4cb9b9edccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.154131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19e341-a15b-4050-9986-f4cb9b9edccc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.154441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19e341-a15b-4050-9986-f4cb9b9edccc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.154699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19e341-a15b-4050-9986-f4cb9b9edccc None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.155468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19e341-a15b-4050-9986-f4cb9b9edccc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.155760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19e341-a15b-4050-9986-f4cb9b9edccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.157987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19e341-a15b-4050-9986-f4cb9b9edccc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.170617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 445/905] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.170617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7aa04-a47f-416f-b668-090305d0d0e6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.170617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7aa04-a47f-416f-b668-090305d0d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.170617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7aa04-a47f-416f-b668-090305d0d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.190002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-08e7aa04-a47f-416f-b668-090305d0d0e6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:54.191388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-08e7aa04-a47f-416f-b668-090305d0d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:54.233166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.286293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 446/906] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:54.287177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7aa04-a47f-416f-b668-090305d0d0e6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.336829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f0aed-4df2-4c7b-b310-843b027faad9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.364556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.403494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.404382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.404653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.404912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.405549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.405843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.407374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.426109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 461/907] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.427956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.490612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7aa04-a47f-416f-b668-090305d0d0e6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.543742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274ec2-276b-4502-83bb-64c394f275c2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.562148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.564038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.564763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.565276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.565596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.568113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.568658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.572422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.585280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 447/908] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:54.596953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.599900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.600928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.601552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.602055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.611294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.613214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:02:54.628614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:54.629615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:02:54.630587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:54.638056 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 462/909] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:54.639752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.768406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186a14e-9b05-42ea-912f-6c456c2c3748 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.802282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.807949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7e86e-f747-4f5b-a8a8-b930f530c3b4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:54.816457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.817660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.818086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.818547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.819441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:54.819909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.821517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.848353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 463/910] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:54.848353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:54.876954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:54.877934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:54.878467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:54.878929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:54.879956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:54.882078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:54.899689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:54.930282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 448/911] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:02:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:54.930282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.037848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08dddf-7d02-4e45-a163-d16e2c07a363 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.103846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.104947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.105299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.105638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.106426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.107248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c746b28-908c-43e4-8f35-10b5c69ee189 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.108280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:55.122618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:55.124748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 08:02:55.127510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:55.133264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 464/912] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:55.133264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.162295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff0573-77d2-4c8e-866a-24c57855b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.163122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff0573-77d2-4c8e-866a-24c57855b64f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.163499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff0573-77d2-4c8e-866a-24c57855b64f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.163876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff0573-77d2-4c8e-866a-24c57855b64f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.214156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.284972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.297721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ba484-d259-4279-b849-98e592d9bb74 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.312310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff0573-77d2-4c8e-866a-24c57855b64f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.315865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff0573-77d2-4c8e-866a-24c57855b64f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.346763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d952f6b-da18-436f-adb2-7b88929fc791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.347712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952f6b-da18-436f-adb2-7b88929fc791 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.348100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952f6b-da18-436f-adb2-7b88929fc791 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.348378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952f6b-da18-436f-adb2-7b88929fc791 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.349027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952f6b-da18-436f-adb2-7b88929fc791 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:55.349329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952f6b-da18-436f-adb2-7b88929fc791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.350936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952f6b-da18-436f-adb2-7b88929fc791 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.357576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 465/913] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:55.360809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1ea3c-9fb4-46d5-b830-11af30cd745b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.361286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1ea3c-9fb4-46d5-b830-11af30cd745b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.361761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1ea3c-9fb4-46d5-b830-11af30cd745b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.368191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 466/914] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:55.368191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1ea3c-9fb4-46d5-b830-11af30cd745b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.477530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 449/915] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:02:54 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:02:55.479542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0717-42cc-4912-9fd2-7f54eefe3e26 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.480025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0717-42cc-4912-9fd2-7f54eefe3e26 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.480451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0717-42cc-4912-9fd2-7f54eefe3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.499458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1ea3c-9fb4-46d5-b830-11af30cd745b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.506547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a98f0717-42cc-4912-9fd2-7f54eefe3e26 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:55.508682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a98f0717-42cc-4912-9fd2-7f54eefe3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:55.541840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.542683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.543141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.543608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.544426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:55.544943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.546789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.553704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 467/916] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:55.554880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.583328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.591609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:55.621946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 450/917] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:55.621946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0717-42cc-4912-9fd2-7f54eefe3e26 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.735606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ee4e5-fb8d-45b8-9929-496401f5924f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.777334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.778135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.778622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.778996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.803477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f0717-42cc-4912-9fd2-7f54eefe3e26 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:55.806842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.810983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:02:55.842979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:55.846321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:02:55.849080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:02:55.849080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:02:55.849080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:55.852377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 468/918] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:55.862290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:55.887216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:55.888887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:55.889587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:55.891097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:55.893055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:55.895801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:55.930332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 451/919] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:02:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:55.932107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:56.028790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:56.036129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:56.114376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b3fff-9b2a-469c-ad58-dcf3717b0d9a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:56.155527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46631a-80d0-4d05-ab49-512515b43208 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:56.192803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:56.194105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:56.194805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:56.195416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:56.196741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:56.197421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:56.200228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:56.224348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 469/920] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:56.232014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:56.232014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:56.232439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:56.232875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:56.232875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:56.232875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:56.235530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:56.255811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 452/921] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:02:55 2022] POST /identity/v3/services => generated 241 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:02:56.448873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f2730-9105-4f4a-8582-e3fa9fd815ad None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:56.507070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:56.529601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:56.530717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:56.531203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:56.532224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:56.545666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:56.549120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:56.572481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:56.574173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:56.576468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 470/922] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:56.581188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:56.701764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:56.706747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab753e-a1e2-4824-a52c-3c4e212d13ae None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:56.745938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c8b5-68d4-4f50-917a-03ef5c45d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:56.746585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c8b5-68d4-4f50-917a-03ef5c45d135 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:56.746861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c8b5-68d4-4f50-917a-03ef5c45d135 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:56.747185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c8b5-68d4-4f50-917a-03ef5c45d135 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:56.747907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c8b5-68d4-4f50-917a-03ef5c45d135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:56.748211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c8b5-68d4-4f50-917a-03ef5c45d135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:56.749682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c8b5-68d4-4f50-917a-03ef5c45d135 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:56.764308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 453/923] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:56.771847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:56.881563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b82cc8-4c33-4f3b-a4bc-4722e2ee2c24 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:56.919057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45175a63-1747-49ec-8465-09a9dffd0056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:56.920068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45175a63-1747-49ec-8465-09a9dffd0056 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:56.920526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45175a63-1747-49ec-8465-09a9dffd0056 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:56.920988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45175a63-1747-49ec-8465-09a9dffd0056 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:56.921897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45175a63-1747-49ec-8465-09a9dffd0056 None admin] RBAC: Adding query filter params (role.id=a91f53910bb54ad89e16e189ca168db0, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=5c37924aa7154c619adb78b69922b333) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:56.922940 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45175a63-1747-49ec-8465-09a9dffd0056 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:56.924563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45175a63-1747-49ec-8465-09a9dffd0056 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:56.931143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 471/924] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:02:56 2022] GET /identity/v3/role_assignments?user.id=5c37924aa7154c619adb78b69922b333&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=a91f53910bb54ad89e16e189ca168db0 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:58.219840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cfdc1-410a-4c39-80ea-40dd8416a396 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.220394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cfdc1-410a-4c39-80ea-40dd8416a396 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.221290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cfdc1-410a-4c39-80ea-40dd8416a396 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.224378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 454/925] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:58.234144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6c53-fffa-4c13-a940-c59817902976 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.235257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6c53-fffa-4c13-a940-c59817902976 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.235893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd6c53-fffa-4c13-a940-c59817902976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.266315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f7bd6c53-fffa-4c13-a940-c59817902976 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:58.268172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f7bd6c53-fffa-4c13-a940-c59817902976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:58.333173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cba73-7644-4aa6-99ee-d17b9c417b1c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.333654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cba73-7644-4aa6-99ee-d17b9c417b1c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.334119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cba73-7644-4aa6-99ee-d17b9c417b1c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.337440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 455/926] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:58.347883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7b89-4688-4392-a90c-055ad8eeeccb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:58.348530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7b89-4688-4392-a90c-055ad8eeeccb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:58.349213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7b89-4688-4392-a90c-055ad8eeeccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:58.353736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:58.385002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 472/927] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:58.385232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-633c7b89-4688-4392-a90c-055ad8eeeccb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:58.385232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-633c7b89-4688-4392-a90c-055ad8eeeccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:58.475783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 456/928] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:58.877084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6c53-fffa-4c13-a940-c59817902976 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:58.991553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd6c53-fffa-4c13-a940-c59817902976 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.001582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7b89-4688-4392-a90c-055ad8eeeccb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.031395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.032024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.032296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.032566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.033233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.034727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.037547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING keystone.server.flask.common [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 08:02:59.058191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.sql.core [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 08:02:59.058191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 08:02:59.058191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [parameters: {'id': '7e855ea213b24982b47469c58440370f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 08:02:59.058191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81643) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e855ea213b24982b47469c58440370f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e855ea213b24982b47469c58440370f. Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:02:59.077500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 08:02:59.079647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application yield resource Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise self.value Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application session.commit() Sep 01 08:02:59.081516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.flush() Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application compat.raise_( Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 08:02:59.083346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 08:02:59.088489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:02:59.092880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [parameters: {'id': '7e855ea213b24982b47469c58440370f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.097933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.101545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7e855ea213b24982b47469c58440370f. Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 473/929] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Sep 1 08:02:58 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:59.105937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.133834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.154705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.175052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7b89-4688-4392-a90c-055ad8eeeccb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.226520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe555-9490-4049-b75b-913b8a10a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.227561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cef81-849d-4f30-beb5-1a81af7857be None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.227738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe555-9490-4049-b75b-913b8a10a6ad None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.227738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe555-9490-4049-b75b-913b8a10a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.227738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe555-9490-4049-b75b-913b8a10a6ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.228269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffe555-9490-4049-b75b-913b8a10a6ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.229671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffe555-9490-4049-b75b-913b8a10a6ad None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0cffe555-9490-4049-b75b-913b8a10a6ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.240279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:59.241431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:02:59.243269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 457/930] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:02:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:59.244286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e3d3-4b37-42f2-9f95-a2a0f137bcd0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.244286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e3d3-4b37-42f2-9f95-a2a0f137bcd0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.244286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852e3d3-4b37-42f2-9f95-a2a0f137bcd0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.249950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 458/931] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:59.249950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10c574-a0c4-4f65-a6a9-0545a7d8ff41 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.249950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10c574-a0c4-4f65-a6a9-0545a7d8ff41 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.249950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10c574-a0c4-4f65-a6a9-0545a7d8ff41 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.249950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 459/932] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:02:59.249950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10c574-a0c4-4f65-a6a9-0545a7d8ff41 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.270233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7038126-49c3-44ac-9615-484ecc509b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.271363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038126-49c3-44ac-9615-484ecc509b61 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.271730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038126-49c3-44ac-9615-484ecc509b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.272100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7038126-49c3-44ac-9615-484ecc509b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.279980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7038126-49c3-44ac-9615-484ecc509b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.282336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7038126-49c3-44ac-9615-484ecc509b61 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e7038126-49c3-44ac-9615-484ecc509b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:02:59.293955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:59.294917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.295780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 474/933] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:02:59.296685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7790bc-fe09-454e-886e-107377cb7a56 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.296685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7790bc-fe09-454e-886e-107377cb7a56 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.296993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7790bc-fe09-454e-886e-107377cb7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.316463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2c7790bc-fe09-454e-886e-107377cb7a56 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:59.318432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2c7790bc-fe09-454e-886e-107377cb7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:59.363771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10c574-a0c4-4f65-a6a9-0545a7d8ff41 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.401868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e7eba-b406-4061-90b7-3315c206083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.402411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7eba-b406-4061-90b7-3315c206083e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.402687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7eba-b406-4061-90b7-3315c206083e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.402961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e7eba-b406-4061-90b7-3315c206083e None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.403606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7eba-b406-4061-90b7-3315c206083e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:59.403914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7eba-b406-4061-90b7-3315c206083e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.405291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e7eba-b406-4061-90b7-3315c206083e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.411166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 460/934] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:02:59.423603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257d0e0-f894-4dda-b35a-419a3a7829eb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.423822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 475/935] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:59.423919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257d0e0-f894-4dda-b35a-419a3a7829eb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.423919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257d0e0-f894-4dda-b35a-419a3a7829eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.424056 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7790bc-fe09-454e-886e-107377cb7a56 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.448417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.454483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9257d0e0-f894-4dda-b35a-419a3a7829eb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:02:59.456408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9257d0e0-f894-4dda-b35a-419a3a7829eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:02:59.474153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.543073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7790bc-fe09-454e-886e-107377cb7a56 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.562446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 461/936] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:02:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:02:59.562446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257d0e0-f894-4dda-b35a-419a3a7829eb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.609210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.610554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.611042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.611350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.612046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:59.612349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.613806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.642270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 476/937] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:59.694282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.731148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257d0e0-f894-4dda-b35a-419a3a7829eb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.787498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.789047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.789905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.790706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.792226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:02:59.793079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:02:59.796111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:02:59.807086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 462/938] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:02:59.818181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.819339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.836788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:02:59.840836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5efe6f-7344-421b-93c2-188b7be085ed None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:02:59.891725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:02:59.892457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:02:59.892920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:02:59.893373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:02:59.913759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:02:59.925051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:02:59.926228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:02:59.927107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 477/939] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:02:59.931792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:02:59.988111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa9c3-55f5-4bed-b569-dda640c5a88e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.062442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.069352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.069352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.069352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.069352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] RBAC: Adding query filter params (interface=public, service_id=e551aadd9380452c812f6fab1adab51e, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.070317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.072694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.082533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 463/940] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/endpoints?service_id=e551aadd9380452c812f6fab1adab51e&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.083915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.093708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e8589-e2e3-460f-9595-e06f10f215d3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.132722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.133468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.133743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.134011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.134630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.136013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:00.147288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:00.148436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:00.149336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 478/941] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:02:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:00.150172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.164380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.215741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.266435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d68eec-2042-42ce-9f25-67242164bb36 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.293486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ae27e-f542-479e-9e77-6f4cbfde12e0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.309104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.310742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.311171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.311610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.313274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.313939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.316611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.332405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 464/942] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.333855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.360867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.361750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.362200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.362690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.363512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.366023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.379201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 479/943] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/services => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:03:00.380266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.502332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5c82e-89ff-486e-a076-c18c942bb868 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.533832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.560746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.561762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.562319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.562933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.563926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.564971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.566097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.570789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.578012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 465/944] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.585211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.598539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a701b9-f8ff-493d-b641-a7f759e06915 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.645667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.646052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.646227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.646529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.659583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.661119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:00.678435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:00.679490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:00.680356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:00.680356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:00.680356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:00.680356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 480/945] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:00.686102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.731049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7fda-3954-42c6-8ef0-f529ee4bdfb9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.772692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.773709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.774221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.774744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.775609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.776123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.777748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.784465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 466/946] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:00.814012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df0026-d0e3-4d44-8aed-bd50efcce58f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:00.846962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:00.857257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:00.858148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:00.858516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:00.858797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:00.859534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:00.860346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:00.861817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:00.881532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 481/947] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:00.883509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:00.977689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.033469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ffd10-32f7-4104-a9ef-99e1876629a6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.080998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.081724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.082225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.082768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.095776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.097594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:01.111007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:01.112022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:01.112949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:01.115598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 467/948] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:03:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:01.125600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.288480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f98f8-2af5-4ede-ae40-3af1e5f1ac2e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.345453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.346076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.346453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.346866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.348200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:01.348538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.350538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.386464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 482/949] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:01.392062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.522515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a6c8-85f7-4b77-a45b-23ea117d14c7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.549561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.561328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796690f1-17db-4f75-9606-e2791fdefbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.561970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796690f1-17db-4f75-9606-e2791fdefbcd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.562265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796690f1-17db-4f75-9606-e2791fdefbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.563067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796690f1-17db-4f75-9606-e2791fdefbcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.575299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796690f1-17db-4f75-9606-e2791fdefbcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.576786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796690f1-17db-4f75-9606-e2791fdefbcd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-796690f1-17db-4f75-9606-e2791fdefbcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:01.595037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:01.596085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:01.596947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:01.596947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:01.596947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:01.596947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 468/950] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:01.606880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:01.693474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:01.798697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99daffb8-d91f-44b7-8eb7-d298cf84323c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:01.856860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f26f99-5ec7-4b02-a37b-1ecc3e820516 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.857059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f26f99-5ec7-4b02-a37b-1ecc3e820516 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.857326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f26f99-5ec7-4b02-a37b-1ecc3e820516 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.859256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 469/951] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:01.865133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:01.866179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.866701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.867178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.868489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:01.869009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:01.871823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:01.872467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea38a4-88ef-4645-92e4-c19570c146dc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:01.872752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea38a4-88ef-4645-92e4-c19570c146dc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:01.873030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ea38a4-88ef-4645-92e4-c19570c146dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:01.897408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-26ea38a4-88ef-4645-92e4-c19570c146dc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:01.898665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-26ea38a4-88ef-4645-92e4-c19570c146dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:01.901223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 483/952] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:01.911187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.016598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 470/953] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:02.109009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde583c0-1f46-497f-b725-26e2b1d0ee5e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.114788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:02.158453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.159126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.159403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.159666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.167989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.169529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:02.192037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:02.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:02.196558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:02.199679 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 484/954] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:02.205546 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea38a4-88ef-4645-92e4-c19570c146dc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.430510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.448548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ea38a4-88ef-4645-92e4-c19570c146dc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.459542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:02.559522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.560532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.560967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.561424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.565040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:02.565689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.568812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.618327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 471/955] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:02.628086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.743751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c9181-165b-4667-bd7d-431124580a0d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.842161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:02.846276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:02.846276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:02.846276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:02.846778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:02.848169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:02.884979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.sql.core [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 08:03:02.884979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 08:03:02.884979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [parameters: {'user_id': 'e58f826dfc2140cb930716e3dbf64348', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 08:03:02.884979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81643) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 01 08:03:02.900305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:03:02.902096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application yield resource Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application next(self.gen) Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise self.value Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application session.commit() Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 08:03:02.904204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.session.flush() Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application compat.raise_( Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 08:03:02.906027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 08:03:02.911392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application conn.query(q) Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application result.read() Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 08:03:02.913065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e58f826dfc2140cb930716e3dbf64348', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:02.914681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 08:03:02.916207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 08:03:02.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 08:03:02.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 08:03:02.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 08:03:02.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 08:03:02.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 08:03:02.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:02.918100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 485/956] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Sep 1 08:03:02 2022] POST /identity/v3/users => generated 160 bytes in 472 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:02.921401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fce52-c84b-4232-b192-36a3b17a0ca3 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:02.922725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:02.975604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:03.030987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c55bdc-6367-4595-a85d-075b996848eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:03.036785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55bdc-6367-4595-a85d-075b996848eb None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.037241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55bdc-6367-4595-a85d-075b996848eb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.037715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c55bdc-6367-4595-a85d-075b996848eb None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/5c37924aa7154c619adb78b69922b333/roles/a91f53910bb54ad89e16e189ca168db0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.052106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c55bdc-6367-4595-a85d-075b996848eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=5c37924aa7154c619adb78b69922b333, role_id=a91f53910bb54ad89e16e189ca168db0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:03.054773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c55bdc-6367-4595-a85d-075b996848eb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:03.110574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 472/957] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:02 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/5c37924aa7154c619adb78b69922b333/roles/a91f53910bb54ad89e16e189ca168db0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:03:03.149754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc05f7-579b-4e5e-bdf7-517e4ad20b64 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:03.180049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac900d08-ed64-4714-9806-593d7ed67551 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.180588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac900d08-ed64-4714-9806-593d7ed67551 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.181027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac900d08-ed64-4714-9806-593d7ed67551 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.184426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 473/958] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:03.192836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7aaf5-ca23-4b50-90ca-33bd004acf8a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.193267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7aaf5-ca23-4b50-90ca-33bd004acf8a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.193711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7aaf5-ca23-4b50-90ca-33bd004acf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.213584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:03.214733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.215250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.215747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.226396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b9d7aaf5-ca23-4b50-90ca-33bd004acf8a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:03.227828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:03.228431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b9d7aaf5-ca23-4b50-90ca-33bd004acf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:03.230215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:03.244658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:03.245663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 08:03:03.246646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:03.249385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 486/959] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:03.259562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:03.273209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:03.374274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 474/960] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:03.378349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614763c-df90-4f96-ba3d-6121ba091fec None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.378349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614763c-df90-4f96-ba3d-6121ba091fec None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.378349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614763c-df90-4f96-ba3d-6121ba091fec None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.380267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 475/961] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:03.387752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2472-fde3-4162-8b01-cad9514cc924 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.388092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2472-fde3-4162-8b01-cad9514cc924 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.388290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2472-fde3-4162-8b01-cad9514cc924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.390384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:03.425235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424a717-fa4f-4a45-83cf-3049f5b8d6db None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:03.425540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-aa2a2472-fde3-4162-8b01-cad9514cc924 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:03.426778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aa2a2472-fde3-4162-8b01-cad9514cc924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:03.494761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b936b-9734-4417-9407-629832f2538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:03.495574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b936b-9734-4417-9407-629832f2538a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.495730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b936b-9734-4417-9407-629832f2538a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.496012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b936b-9734-4417-9407-629832f2538a None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.496747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b936b-9734-4417-9407-629832f2538a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:03.497061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b936b-9734-4417-9407-629832f2538a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:03.498857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b936b-9734-4417-9407-629832f2538a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:03.543547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 487/962] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Sep 1 08:03:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:03.559668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 476/963] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:03.662975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b936b-9734-4417-9407-629832f2538a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:03.852357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b936b-9734-4417-9407-629832f2538a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:03.891758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2472-fde3-4162-8b01-cad9514cc924 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:03.919338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:03.919892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:03.920167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:03.920437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:03.921032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:03.923160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:03.938099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:03.940229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:03.941136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 488/964] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:03.946074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:03.958336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:04.023236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:04.045451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2472-fde3-4162-8b01-cad9514cc924 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:04.077297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fc8a6-5bb9-4c7c-844d-2d0445d6db67 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:04.102834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:04.103671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.104120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.104562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.105382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:04.107799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:04.132159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 477/965] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:03 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:04.145688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:04.146573 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.147032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.147432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.148220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:04.148701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:04.150234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:04.157211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 489/966] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:04.166638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:04.354700 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65037265-63b3-45cf-925d-dfac04b70931 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:04.420648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c99b0-f2a7-4813-89fc-a1dff3dfffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:04.422114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c99b0-f2a7-4813-89fc-a1dff3dfffc7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.422778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c99b0-f2a7-4813-89fc-a1dff3dfffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.423586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c99b0-f2a7-4813-89fc-a1dff3dfffc7 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.424830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c99b0-f2a7-4813-89fc-a1dff3dfffc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:04.425363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c99b0-f2a7-4813-89fc-a1dff3dfffc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:04.428222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c99b0-f2a7-4813-89fc-a1dff3dfffc7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:04.438668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 478/967] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:04.448598 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:04.580885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:04.658635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d20bfa-6cec-45bc-b1e1-49797d0eef73 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:04.714822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c869b9-13b5-48ec-942b-a1332eee8400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:04.715606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c869b9-13b5-48ec-942b-a1332eee8400 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:04.716019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c869b9-13b5-48ec-942b-a1332eee8400 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:04.716422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c869b9-13b5-48ec-942b-a1332eee8400 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:04.717222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c869b9-13b5-48ec-942b-a1332eee8400 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:04.719394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c869b9-13b5-48ec-942b-a1332eee8400 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:04.743651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 490/968] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:05.314274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069a55-1ff4-41d8-9e55-80faa4ecaefb None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.314826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069a55-1ff4-41d8-9e55-80faa4ecaefb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.315169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069a55-1ff4-41d8-9e55-80faa4ecaefb None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.317865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 479/969] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:05.323595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8579-ebc5-4bc4-a802-3354763eaf34 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.323967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8579-ebc5-4bc4-a802-3354763eaf34 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.324167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8579-ebc5-4bc4-a802-3354763eaf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:05.345659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b77f8579-ebc5-4bc4-a802-3354763eaf34 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:05.347332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b77f8579-ebc5-4bc4-a802-3354763eaf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:05.439158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 491/970] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:05.711920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069a55-1ff4-41d8-9e55-80faa4ecaefb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:05.741584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:05.920110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069a55-1ff4-41d8-9e55-80faa4ecaefb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:05.985486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bd75d-84eb-4c48-bd39-e99e306394ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:05.986600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd75d-84eb-4c48-bd39-e99e306394ff None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:05.987074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd75d-84eb-4c48-bd39-e99e306394ff None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:05.987547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd75d-84eb-4c48-bd39-e99e306394ff None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.008632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bd75d-84eb-4c48-bd39-e99e306394ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c60bd75d-84eb-4c48-bd39-e99e306394ff None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:06.018923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:06.019910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:06.020749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:06.021512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 480/971] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:06.032150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f8579-ebc5-4bc4-a802-3354763eaf34 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.125659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.207407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f8579-ebc5-4bc4-a802-3354763eaf34 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.228831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed1740-c3ae-447e-a436-fe9bbe35a9b7 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.229321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed1740-c3ae-447e-a436-fe9bbe35a9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.229824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed1740-c3ae-447e-a436-fe9bbe35a9b7 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.232294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 481/972] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:06.241566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7887fad-f073-4e04-95de-811b463b0722 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.242793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7887fad-f073-4e04-95de-811b463b0722 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.243288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7887fad-f073-4e04-95de-811b463b0722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.259089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.259719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.259992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.260267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.260955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:06.261261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.262693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.273055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 492/973] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:06.276096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b7887fad-f073-4e04-95de-811b463b0722 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:06.278177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b7887fad-f073-4e04-95de-811b463b0722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:06.278699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.395723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.406792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 482/974] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:06.426947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15872977-06c0-41bd-8795-495e4dde0adf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.443353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.470094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.470665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.470944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.471233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.483948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.485470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:06.501159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:06.503035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:06.504124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:06.504124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:06.504124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:06.507447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 493/975] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:06.508260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7887fad-f073-4e04-95de-811b463b0722 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.658585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7887fad-f073-4e04-95de-811b463b0722 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.710085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.711023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.711517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.712008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.713134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:06.713640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.716299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.743902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 483/976] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:06.744073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.745317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.815816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:06.864044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453697-aa57-4026-b528-a55793fc631e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.880202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6d408-23a5-4732-98df-f5c56d25ca61 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:06.910975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.911749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.912088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.912408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.923878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.924696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a9f92-743f-419c-8acc-8770fcdac824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:06.925445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a9f92-743f-419c-8acc-8770fcdac824 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.925617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.925887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a9f92-743f-419c-8acc-8770fcdac824 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.926276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a9f92-743f-419c-8acc-8770fcdac824 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.926984 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a9f92-743f-419c-8acc-8770fcdac824 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:06.928682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a9f92-743f-419c-8acc-8770fcdac824 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-b24a9f92-743f-419c-8acc-8770fcdac824 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:06.939840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:06.942101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:06.944196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:06.945920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:06.947923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 08:03:06.950041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:06.951181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 494/977] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:06.951181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38a97-f3ee-49f1-8786-dd370e75be0e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.951181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38a97-f3ee-49f1-8786-dd370e75be0e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.951181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c38a97-f3ee-49f1-8786-dd370e75be0e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.951649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 484/978] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:06.951649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:06.954458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 495/979] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:06.956132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d64067-332e-4e54-b486-e44d4c93834b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:06.956531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d64067-332e-4e54-b486-e44d4c93834b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:06.956899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d64067-332e-4e54-b486-e44d4c93834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:06.980028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b0d64067-332e-4e54-b486-e44d4c93834b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:06.981981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b0d64067-332e-4e54-b486-e44d4c93834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:07.020225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.073557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 496/980] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:07.075237 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d64067-332e-4e54-b486-e44d4c93834b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.101350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d3e6c-7bdf-4861-83b6-e1dbb9c05e7d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.131349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.156448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.157602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.158045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.158657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.159610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.160061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.162727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.175387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 485/981] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:07.177386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.230451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d64067-332e-4e54-b486-e44d4c93834b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.285716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.286314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.286672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.286952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.287794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.288102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.289568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.316361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 497/982] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:07.322601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.356060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.358930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524663-a102-48c8-8493-68b883292dc7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.402790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.403832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.403832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.404172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.404559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.404863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.407028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.412864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 486/983] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:07.414807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.471176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900c3b9-712b-44bf-8deb-a8cda8019172 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.473744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.517229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.518293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.518838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.519318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.537034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ed4ea-3aa2-4ac1-9bdb-3e03e86dc4c1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.574883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.575775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.576210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.576620 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.577305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.579731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:07.589214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:07.593440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:07.596116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 487/984] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:07.599098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.639742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.642650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.668433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.736788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717563d-8b66-4030-8604-454653dc0162 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.750824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.780736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.782455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.782756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.783040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.783778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] RBAC: Adding query filter params (interface=public, service_id=92570282b71545429cc29e83e68f6713, region_id=RegionOne) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.784083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.785489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.791647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 488/985] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/endpoints?service_id=92570282b71545429cc29e83e68f6713&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:07.792410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.811002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 498/986] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 08:03:07.812902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:07.932210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395e316-ecdd-498d-a4c1-370ffbb1a790 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.936842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb51e75-ce87-4037-8d30-497947c9b88e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:07.965165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:07.985483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.986531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.986997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.987451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.988596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:07.989104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.990532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:07.991600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:07.991776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:07.992090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:07.992524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:07.993838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:07.996851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.001070 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 489/987] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:08.002351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.009856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 499/988] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:07 2022] GET /identity/v3/services => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:03:08.011027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.085971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:08.166077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70aabc9-c767-4e84-97eb-0e91b268d07e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.173941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca946db-d6af-44df-9f25-16a7923a6df8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.222645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.223735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.224190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.224652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.236527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.237327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.237760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.238194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.239001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:08.239463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.241532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.244597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.247227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.250637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 500/989] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:08.256559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:08.273823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:08.274920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:08.275790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:08.275790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:08.275790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:08.275790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 490/990] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:08.282692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.333538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:08.432391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:08.435585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572d4c9-7a69-40f0-87d4-2761f0b191fa None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.445992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410b76d-11d9-402f-be23-e8f2afa00727 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.491086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.491983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.492248 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.492519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.493742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] RBAC: Adding query filter params (interface=admin, service_id=e551aadd9380452c812f6fab1adab51e, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:08.494045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.495788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.502862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 501/991] 10.222.0.36 () {56 vars in 1249 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/endpoints?service_id=e551aadd9380452c812f6fab1adab51e&interface=admin®ion_id=RegionOne => generated 193 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:08.503271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.504229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.504761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.505254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.506448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:08.507098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.508231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.509796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.534681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 491/992] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:08.543122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.672244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27437c6-ca5a-45ca-b3be-c8d4cb7e96af None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.685604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:08.723747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.724603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.725015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.725436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.726333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.728124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.738305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 502/993] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/services => generated 1727 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:03:08.749369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc723158-91dd-4644-ba14-31b217518b71 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:08.797786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:08.798493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:08.798778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:08.799037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:08.807851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:08.809484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:08.823317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:08.831313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:08.833340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 492/994] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:08.839730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:08.988222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d605e-f4e5-4aef-a939-838f673bd169 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:09.052591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6e12a-937c-4471-9da3-be363c682a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:09.053623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e12a-937c-4471-9da3-be363c682a9d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.054098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e12a-937c-4471-9da3-be363c682a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.054593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6e12a-937c-4471-9da3-be363c682a9d None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.055937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6e12a-937c-4471-9da3-be363c682a9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:09.056447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6e12a-937c-4471-9da3-be363c682a9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:09.059177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6e12a-937c-4471-9da3-be363c682a9d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:09.086447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 503/995] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:09.094348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:09.122199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:09.296171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890874b7-2c86-42cf-82c3-3140e5702167 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:09.362395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389f8c2-ca7a-44f1-9491-88636954926e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:09.363417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f8c2-ca7a-44f1-9491-88636954926e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:09.363922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f8c2-ca7a-44f1-9491-88636954926e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:09.364406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f8c2-ca7a-44f1-9491-88636954926e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:09.365788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f8c2-ca7a-44f1-9491-88636954926e None admin] RBAC: Adding query filter params (role.id=a91f53910bb54ad89e16e189ca168db0, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=5c37924aa7154c619adb78b69922b333) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:09.366375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f8c2-ca7a-44f1-9491-88636954926e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:09.369207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f8c2-ca7a-44f1-9491-88636954926e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:09.390282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 493/996] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:09 2022] GET /identity/v3/role_assignments?user.id=5c37924aa7154c619adb78b69922b333&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=a91f53910bb54ad89e16e189ca168db0 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:10.360779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff051-a190-484e-b2d3-0ab69e940403 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.361720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff051-a190-484e-b2d3-0ab69e940403 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.361720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff051-a190-484e-b2d3-0ab69e940403 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.364337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 504/997] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:10.373092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6896d-b300-4766-8aab-1617e00d4be1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.373863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6896d-b300-4766-8aab-1617e00d4be1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.374173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6896d-b300-4766-8aab-1617e00d4be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.406583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0ec6896d-b300-4766-8aab-1617e00d4be1 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:10.408862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0ec6896d-b300-4766-8aab-1617e00d4be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:10.538644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 494/998] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:10.846442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d787c-f069-464a-a6f7-3cb93ea79d3b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.846736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d787c-f069-464a-a6f7-3cb93ea79d3b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.847037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d787c-f069-464a-a6f7-3cb93ea79d3b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.848328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 505/999] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:10.855051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac58af4-3ebb-495f-add6-56c37a0a7680 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:10.855612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac58af4-3ebb-495f-add6-56c37a0a7680 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:10.856071 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac58af4-3ebb-495f-add6-56c37a0a7680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:10.877179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:10.886181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-eac58af4-3ebb-495f-add6-56c37a0a7680 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:10.888084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eac58af4-3ebb-495f-add6-56c37a0a7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:11.013781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 495/1000] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:10 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:11.048168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d787c-f069-464a-a6f7-3cb93ea79d3b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.107711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.246659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d787c-f069-464a-a6f7-3cb93ea79d3b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.308706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac58af4-3ebb-495f-add6-56c37a0a7680 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.311334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.312953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.313446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.314165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.315275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.317908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:11.335740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:11.338718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:11.339644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 506/1001] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:11.347576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.445207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac58af4-3ebb-495f-add6-56c37a0a7680 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.490518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.491501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.492010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.492595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.493233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.494717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.499030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:11.508953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:11.510974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:11.512672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 496/1002] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:11.517746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.529942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.537640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd2821-1083-401f-aa85-45dffb527496 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.574798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40120200-a713-4fbf-975c-d206c4d0b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.575414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120200-a713-4fbf-975c-d206c4d0b202 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.575695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120200-a713-4fbf-975c-d206c4d0b202 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.575977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40120200-a713-4fbf-975c-d206c4d0b202 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.576606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120200-a713-4fbf-975c-d206c4d0b202 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:11.576905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120200-a713-4fbf-975c-d206c4d0b202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.579193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40120200-a713-4fbf-975c-d206c4d0b202 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.584314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 507/1003] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:11.585567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaaf24-7fff-4582-b423-8c4ee131d2ce None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.585837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaaf24-7fff-4582-b423-8c4ee131d2ce None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.586128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaaf24-7fff-4582-b423-8c4ee131d2ce None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.587878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 508/1004] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:11.592210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaaf24-7fff-4582-b423-8c4ee131d2ce None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.676332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e943a7-6e2c-40a1-add4-0f6adfb82ca7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.720868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf79a3a-bf9d-40ad-8580-4705d15efe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.721106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaaf24-7fff-4582-b423-8c4ee131d2ce None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.721515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79a3a-bf9d-40ad-8580-4705d15efe00 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.721856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79a3a-bf9d-40ad-8580-4705d15efe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.722405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79a3a-bf9d-40ad-8580-4705d15efe00 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.722996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf79a3a-bf9d-40ad-8580-4705d15efe00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:11.723393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf79a3a-bf9d-40ad-8580-4705d15efe00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.724892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf79a3a-bf9d-40ad-8580-4705d15efe00 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.730586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 497/1005] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:11.732943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25742a-9611-4879-8e6a-3c6e22923c54 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.733426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25742a-9611-4879-8e6a-3c6e22923c54 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.733904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25742a-9611-4879-8e6a-3c6e22923c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.755698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1c25742a-9611-4879-8e6a-3c6e22923c54 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:11.756920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1c25742a-9611-4879-8e6a-3c6e22923c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:11.768701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.769504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.769960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.770398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.771250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:11.771625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.773285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.779771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 509/1006] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:11.780601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.813271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.830314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:11.840527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 498/1007] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:11.841198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25742a-9611-4879-8e6a-3c6e22923c54 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:11.934094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17746f68-8790-42e0-8531-d66a781f562b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.957561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25742a-9611-4879-8e6a-3c6e22923c54 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:11.979484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:11.980170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:11.980551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:11.980925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:11.981692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:11.982097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:11.983884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:11.995155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 510/1008] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Sep 1 08:03:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:11.996184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.019939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.020563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.020840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.021112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.021795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.023218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.046560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 499/1009] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:12.153914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:12.177717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94fd9e-62c9-4d96-bf06-498797fb79c4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.253359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.254225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.254710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.255178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.256271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.258472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.285655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 511/1010] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:12.300229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.389779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:12.489054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5b65f-780d-45e0-95bd-941fac95725e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.542487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.543205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.543484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.543753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.544346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.545728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:12.556350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:12.557443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:12.558570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 500/1011] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/services/image => generated 86 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:12.564427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:12.722960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fd1ae-b0fa-47ff-9f20-728662908e0e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:12.798155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ac6e4-8070-43b0-93b7-609fc0fb144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:12.798937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ac6e4-8070-43b0-93b7-609fc0fb144c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:12.799301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ac6e4-8070-43b0-93b7-609fc0fb144c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:12.799574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ac6e4-8070-43b0-93b7-609fc0fb144c None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:12.800320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ac6e4-8070-43b0-93b7-609fc0fb144c None admin] RBAC: Adding query filter params (name=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:12.800622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ac6e4-8070-43b0-93b7-609fc0fb144c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:12.802114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ac6e4-8070-43b0-93b7-609fc0fb144c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:12.809802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 512/1012] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:12.816980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:13.009244 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e918d61-384b-4c43-9210-e9c3743b63d9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:13.031740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:13.084609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83931552-f13a-4340-bed4-c7141ae60f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:13.085614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83931552-f13a-4340-bed4-c7141ae60f6d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:13.086111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83931552-f13a-4340-bed4-c7141ae60f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:13.086634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83931552-f13a-4340-bed4-c7141ae60f6d None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:13.087830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83931552-f13a-4340-bed4-c7141ae60f6d None admin] RBAC: Adding query filter params (type=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:13.088392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83931552-f13a-4340-bed4-c7141ae60f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:13.091101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83931552-f13a-4340-bed4-c7141ae60f6d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:13.106297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 501/1013] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:14.230689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434eb25-4d35-476b-b23c-561c5574058a None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.231217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434eb25-4d35-476b-b23c-561c5574058a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.231754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434eb25-4d35-476b-b23c-561c5574058a None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.236281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 513/1014] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:14.242962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e828a-ba9b-443c-93c7-3e3a36c57279 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.243487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e828a-ba9b-443c-93c7-3e3a36c57279 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.244049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e828a-ba9b-443c-93c7-3e3a36c57279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.271577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-194e828a-ba9b-443c-93c7-3e3a36c57279 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:14.272792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-194e828a-ba9b-443c-93c7-3e3a36c57279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:14.331810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85218a8-ea37-491a-b20b-fcc147d4098f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.332488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85218a8-ea37-491a-b20b-fcc147d4098f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.333062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85218a8-ea37-491a-b20b-fcc147d4098f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.335843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 514/1015] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:14.342716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba45b1-4b98-4cc8-8e82-37d1c11a3981 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.342998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba45b1-4b98-4cc8-8e82-37d1c11a3981 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.343828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba45b1-4b98-4cc8-8e82-37d1c11a3981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.361646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 502/1016] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:14 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:14.364201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e0ba45b1-4b98-4cc8-8e82-37d1c11a3981 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:14.365432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e0ba45b1-4b98-4cc8-8e82-37d1c11a3981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:14.370718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:14.490111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 515/1017] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:14 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:14.697720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e828a-ba9b-443c-93c7-3e3a36c57279 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.762413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba45b1-4b98-4cc8-8e82-37d1c11a3981 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.835828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e828a-ba9b-443c-93c7-3e3a36c57279 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.840875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:14.906360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.907563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.908076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.908527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.915698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba45b1-4b98-4cc8-8e82-37d1c11a3981 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:14.929358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:14.939881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:14.941767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:14.943992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:14.946454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 503/1018] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:14.951773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:14.978414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:14.979480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:14.979967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:14.980456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:14.982609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:14.985718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:14.992415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 516/1019] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:14.998699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:15.015971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:15.112263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450a98b-b17c-49e1-b133-3fad0d82d01a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:15.169332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:15.170392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.170779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.171098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.172389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:15.172766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:15.174090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:15.176027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15ff5d-be97-42de-ab81-6f8f61ec46ae None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:15.194507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 504/1020] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:15.197044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:15.222603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:15.223226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.223492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.223768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.224431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:15.225880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:15.259393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:15.264827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 517/1021] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:14 2022] POST /identity/v3/projects => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:15.410360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08f75-acfa-4344-ac73-9625f8fb46fd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:15.479794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaf268-3a67-4386-8fb6-90a38bce5f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:15.480890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf268-3a67-4386-8fb6-90a38bce5f0c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.481389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf268-3a67-4386-8fb6-90a38bce5f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.481878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf268-3a67-4386-8fb6-90a38bce5f0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.502999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaf268-3a67-4386-8fb6-90a38bce5f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:15.505304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaf268-3a67-4386-8fb6-90a38bce5f0c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-a3aaf268-3a67-4386-8fb6-90a38bce5f0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:15.533292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:15.534523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:15.535474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:15.535474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:15.535474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:15.535748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 505/1022] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:15.546014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:15.606975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e5ce-12dd-4777-8b63-4cbe07cbbd67 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.607549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e5ce-12dd-4777-8b63-4cbe07cbbd67 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.607797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e5ce-12dd-4777-8b63-4cbe07cbbd67 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.614082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 506/1023] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:15.615921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43644-7576-4cf8-96f6-a1ab5950d69d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.616279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43644-7576-4cf8-96f6-a1ab5950d69d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.616627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43644-7576-4cf8-96f6-a1ab5950d69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.636739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1eb43644-7576-4cf8-96f6-a1ab5950d69d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:15.638086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1eb43644-7576-4cf8-96f6-a1ab5950d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:15.651430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:15.714903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a737d-ad6a-4366-9335-62817a32748a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:15.744125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 507/1024] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:15 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:15.762522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:15.763490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:15.763913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:15.764331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:15.765709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:15.766375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:15.768296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:15.783619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 518/1025] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:15.792957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb43644-7576-4cf8-96f6-a1ab5950d69d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:15.813456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:15.986494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb43644-7576-4cf8-96f6-a1ab5950d69d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:16.050993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:16.052053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.052514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.053067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.066829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:16.069560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:16.092803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:16.095286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:16.097909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:16.102709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 508/1026] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:03:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:16.105114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:16.114303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:16.220368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:16.286734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798fc94-203e-4b08-91fd-3ec1faa2a2e8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:16.295411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d9d68-f2f0-48da-9944-1c80d6fca6cf None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:16.317914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:16.342219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:16.343036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.343946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.344330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.345479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:16.345893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:16.347476 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:16.351297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:16.352336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.352802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.353272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.354552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:16.357404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:16.371901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 519/1027] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:03:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:16.377844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:16.390646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 509/1028] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:16 2022] POST /identity/v3/services => generated 242 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:16.508156 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2da3fb-be56-4df1-ae5f-624d3f2fcbeb None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:16.556909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:16.557584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.557967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.558372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.624219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:16.661205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:16.662719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:16.779027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 520/1029] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:16.785879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:16.908168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd045624-fa2c-4459-9148-d8a5f6ecf294 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:16.940786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:16.952247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:16.955189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:16.955526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:16.955774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:16.970615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:16.972236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:16.989283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:16.991163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:16.992868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:16.992868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:16.992868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:16.994598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 510/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:16.996453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.087591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.123524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009298f3-460a-4b5f-b8d2-68aa8336e64a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.163859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.164407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.164690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.164961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.165628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:17.166009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.167601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.185345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 521/1031] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:17.187485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.305241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48da87a-c8f6-4a77-849f-8318f4bd3ef9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.347961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.348601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.348878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.349147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.356504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.358223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:17.370902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:17.371845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:17.378344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 511/1032] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:17.380660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.495256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5f144-c8fe-43a9-a3ab-4637184050a5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.528026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.535762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f0137-51de-4c8d-a4a6-42da5cf42a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.536388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0137-51de-4c8d-a4a6-42da5cf42a57 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.536676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0137-51de-4c8d-a4a6-42da5cf42a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.536929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f0137-51de-4c8d-a4a6-42da5cf42a57 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.537638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0137-51de-4c8d-a4a6-42da5cf42a57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:17.537970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0137-51de-4c8d-a4a6-42da5cf42a57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.539444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f0137-51de-4c8d-a4a6-42da5cf42a57 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.558807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 522/1033] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:17.560909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:17.649285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:17.759990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf8b6a-87dc-46e7-872f-d522ebd12deb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:17.825466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13145c1b-5b3e-4e00-a0ef-ea23ddafddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:17.826936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145c1b-5b3e-4e00-a0ef-ea23ddafddfd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.827104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145c1b-5b3e-4e00-a0ef-ea23ddafddfd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.828109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13145c1b-5b3e-4e00-a0ef-ea23ddafddfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.830381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13145c1b-5b3e-4e00-a0ef-ea23ddafddfd None admin] RBAC: Adding query filter params (role.id=a91f53910bb54ad89e16e189ca168db0, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=3a545f5fde0d432fbe31819eb5c7c39d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:17.830923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13145c1b-5b3e-4e00-a0ef-ea23ddafddfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:17.833684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13145c1b-5b3e-4e00-a0ef-ea23ddafddfd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:17.850279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 512/1034] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:17 2022] GET /identity/v3/role_assignments?user.id=3a545f5fde0d432fbe31819eb5c7c39d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=a91f53910bb54ad89e16e189ca168db0 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:17.913630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca97f6-952d-4373-8c0b-249dc5d2f088 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.914136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca97f6-952d-4373-8c0b-249dc5d2f088 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.914673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca97f6-952d-4373-8c0b-249dc5d2f088 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.917469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 523/1035] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:17.924605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070bb5-3d9e-4848-9820-95c492f57bd4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:17.925069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070bb5-3d9e-4848-9820-95c492f57bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:17.925471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50070bb5-3d9e-4848-9820-95c492f57bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:17.954032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-50070bb5-3d9e-4848-9820-95c492f57bd4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:17.955930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-50070bb5-3d9e-4848-9820-95c492f57bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:18.075423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 513/1036] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:18.563463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca97f6-952d-4373-8c0b-249dc5d2f088 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:18.767273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca97f6-952d-4373-8c0b-249dc5d2f088 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:18.793858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70e6e7-ae91-431e-bcaa-5e804875ff85 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.794730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70e6e7-ae91-431e-bcaa-5e804875ff85 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.794730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70e6e7-ae91-431e-bcaa-5e804875ff85 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.796073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 514/1037] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:03:18.804857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973453c-d390-4e05-bce5-4b2786f105fe None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.805142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973453c-d390-4e05-bce5-4b2786f105fe None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.805381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973453c-d390-4e05-bce5-4b2786f105fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.827619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0973453c-d390-4e05-bce5-4b2786f105fe None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:18.829286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0973453c-d390-4e05-bce5-4b2786f105fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:18.842041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:18.844073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:18.844761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:18.845414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:18.848102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:18.851087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:18.858287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 524/1038] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:18.864282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:18.874224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:18.946439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 515/1039] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:18.948198 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:19.024626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e3098-392f-4f98-a662-1d17d85f079e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.088482 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.089467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.089973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.090523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.091779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.095191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.131977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 525/1040] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:03:18 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:03:19.430153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973453c-d390-4e05-bce5-4b2786f105fe None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.565241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973453c-d390-4e05-bce5-4b2786f105fe None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.614574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.615636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.616126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.616613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] PATH_INFO: `/v3/services/image` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.617676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.620292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:19.637242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:19.639626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:19.642206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:19.646342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 516/1041] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:19.649502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.842198 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47a9f-a8b2-4387-9d1b-04b32bb673b0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:19.878153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:19.913869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:19.914888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:19.915337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:19.915763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:19.916819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:19.917294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:19.919746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:19.934291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 526/1042] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:19.940495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:19.998612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:20.150893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76fea3-6875-4beb-800c-cf0c720dffc8 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:20.209559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32b42a-cf80-4a37-909e-fb8df68b7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:20.210174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b42a-cf80-4a37-909e-fb8df68b7760 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.210480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b42a-cf80-4a37-909e-fb8df68b7760 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.210749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32b42a-cf80-4a37-909e-fb8df68b7760 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.211402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32b42a-cf80-4a37-909e-fb8df68b7760 None admin] RBAC: Adding query filter params (type=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:20.211691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32b42a-cf80-4a37-909e-fb8df68b7760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.213110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32b42a-cf80-4a37-909e-fb8df68b7760 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.220056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 517/1043] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:20.226642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:20.423151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb66149-8dc7-4b8c-8d8c-2daf79578ad1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:20.489176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:20.490202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.490716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.491200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.492498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] RBAC: Adding query filter params (interface=public, service_id=c745f21db113426cb188ace06618e59c, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:20.493048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.495493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.510809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 527/1044] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:03:20 2022] GET /identity/v3/endpoints?service_id=c745f21db113426cb188ace06618e59c&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:20.513187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a29c9-c1f7-464d-b90c-7cf172e14871 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.513630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a29c9-c1f7-464d-b90c-7cf172e14871 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.514133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a29c9-c1f7-464d-b90c-7cf172e14871 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.516862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:20.517527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 518/1045] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:20.523196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1956ba-bc4d-404e-80a3-23397c38fabf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.523596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1956ba-bc4d-404e-80a3-23397c38fabf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.523757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1956ba-bc4d-404e-80a3-23397c38fabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.543636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5f1956ba-bc4d-404e-80a3-23397c38fabf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:20.544853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5f1956ba-bc4d-404e-80a3-23397c38fabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:20.605427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:20.640755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 519/1046] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:20.704648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48be365-cb7f-4fa5-a622-edda183ef3f0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:20.764775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c207117-876a-44af-b93a-28f09c1039dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:20.766378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c207117-876a-44af-b93a-28f09c1039dd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:20.766871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c207117-876a-44af-b93a-28f09c1039dd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:20.767343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c207117-876a-44af-b93a-28f09c1039dd None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:20.768351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c207117-876a-44af-b93a-28f09c1039dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:20.770832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c207117-876a-44af-b93a-28f09c1039dd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:20.790530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 528/1047] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:03:20 2022] GET /identity/v3/services => generated 1957 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:03:21.150592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1956ba-bc4d-404e-80a3-23397c38fabf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.199086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:21.305167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f9d8-b23c-4cfa-8a9a-297d8f2bd834 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.305431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f9d8-b23c-4cfa-8a9a-297d8f2bd834 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.305821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f9d8-b23c-4cfa-8a9a-297d8f2bd834 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.307424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 529/1048] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:21.313509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1956ba-bc4d-404e-80a3-23397c38fabf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:21.315856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf273cf-a4ed-4340-9cd2-f9da550d3dd6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.316135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf273cf-a4ed-4340-9cd2-f9da550d3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.316394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf273cf-a4ed-4340-9cd2-f9da550d3dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.337400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9cf273cf-a4ed-4340-9cd2-f9da550d3dd6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:21.338670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9cf273cf-a4ed-4340-9cd2-f9da550d3dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:21.384043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:21.385398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.386402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.386960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.408840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:21.417752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:21.418811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:21.420301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 520/1049] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:21.430128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.439927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 530/1050] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:21.540432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:21.564079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e72a-0955-44ec-ae7e-4bf0a9d00d87 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:21.614618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:21.615445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.615903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.616311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.617171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:21.617610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:21.619204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:21.630068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 521/1051] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:21.635978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf273cf-a4ed-4340-9cd2-f9da550d3dd6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.682507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:21.757414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf273cf-a4ed-4340-9cd2-f9da550d3dd6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:21.801823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:21.802692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:21.803105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:21.803569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:21.817168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:21.818997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:21.837386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:21.839593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:21.841365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:21.841365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:21.841365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:21.846320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 531/1052] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:21.847451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.935822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:21.972699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5186a8-6f82-4596-99ef-4a634c554b9c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.027717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.028673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.029154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.029597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.031004 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:22.031550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:22.034025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:22.055851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 522/1053] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:22.064382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.068871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.104065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.123037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d7247-7dea-4283-8255-5921c51a59d5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.190098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.191098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.191597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.192089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.210262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:22.215344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27f20d-0287-420f-8b06-0e1e09076d0c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:22.216134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:22.217881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:22.219562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 532/1054] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:22.228854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.263052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.263948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.264355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.264763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.274262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:22.276004 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:22.291473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:22.293406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:22.296756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 523/1055] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:22.303087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.395779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.442574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5b1c15-6d16-4018-b89a-ac95b478a707 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.450999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c7aa4-6f1a-46a8-ae35-ebb1dad4dbbc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.496479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.497169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.497513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.497849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.498726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:22.499103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:22.501699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:22.507353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.508611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.509284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.509933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.511162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:22.511674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:22.513951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:22.524479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 524/1056] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:22.538026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 533/1057] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:22.538602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.539803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.565985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.697060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921b76-e31d-4f94-b261-124b1b985ce9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.722162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c19d5-c09f-47a0-8060-89701797f26c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.744866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.762533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.763362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.763774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.764379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.777426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:22.778940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:22.781203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:22.782762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:22.783187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:22.783524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] PATH_INFO: `/v3/users/ac4ad4ff79c949d2a30c206da5308e4a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:22.799874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:22.801490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:22.803412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:22.803412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:22.803412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:22.803412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 525/1058] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:22.809894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.811578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] RBAC: Authorizing `identity:get_user(user_id=ac4ad4ff79c949d2a30c206da5308e4a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:22.817840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:22.821687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 534/1059] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/users/ac4ad4ff79c949d2a30c206da5308e4a => generated 285 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:22.827317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:22.934326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:22.980795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00569829-0477-4161-bac5-b83d284a9527 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:22.985097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d405b5-53bf-429d-88e8-9b7eb0957a4c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.031967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5c4d1-7c58-440c-984b-d1d3ac089f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.032726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5c4d1-7c58-440c-984b-d1d3ac089f70 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.033101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5c4d1-7c58-440c-984b-d1d3ac089f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.033476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5c4d1-7c58-440c-984b-d1d3ac089f70 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.034235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5c4d1-7c58-440c-984b-d1d3ac089f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:23.034700 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5c4d1-7c58-440c-984b-d1d3ac089f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.036205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5c4d1-7c58-440c-984b-d1d3ac089f70 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.037412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af07d86-3fb2-403a-bf89-b29f270b3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.038561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07d86-3fb2-403a-bf89-b29f270b3af9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.039080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07d86-3fb2-403a-bf89-b29f270b3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.039582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af07d86-3fb2-403a-bf89-b29f270b3af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.049981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 526/1060] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:23.051345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310e541-53b6-4ba1-bb74-083c8b2cad4d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.051615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310e541-53b6-4ba1-bb74-083c8b2cad4d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.051877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310e541-53b6-4ba1-bb74-083c8b2cad4d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.053113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 527/1061] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:23.056863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310e541-53b6-4ba1-bb74-083c8b2cad4d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.109799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.153673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af07d86-3fb2-403a-bf89-b29f270b3af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.156351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af07d86-3fb2-403a-bf89-b29f270b3af9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.213446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310e541-53b6-4ba1-bb74-083c8b2cad4d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.250648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.251646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.252284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.252555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.252820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.265478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.268346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.285543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 535/1062] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:22 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 08:03:23.286945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd78e2-95aa-44a1-ad9d-36411f1df87d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.287249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd78e2-95aa-44a1-ad9d-36411f1df87d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.287503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd78e2-95aa-44a1-ad9d-36411f1df87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:23.291146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:23.293182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 528/1063] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:23.295571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.312252 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-17dd78e2-95aa-44a1-ad9d-36411f1df87d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:23.313672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-17dd78e2-95aa-44a1-ad9d-36411f1df87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:23.390572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 536/1064] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:23.392561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd78e2-95aa-44a1-ad9d-36411f1df87d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.429253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.439728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac0c2-0dd3-42d2-b0ac-9b722bfff421 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.485837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.486674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.486970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.487233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.488708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] RBAC: Authorizing `identity:get_project(project_id=b7bf2693bf6449e487bffeb43d15124b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.490205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.500763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 529/1065] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:23.502025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.588977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.597340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd78e2-95aa-44a1-ad9d-36411f1df87d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.651755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016ac63-8954-4058-a5af-6f51eb747808 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.667624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.668660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.669153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.669644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.670963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:23.671549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.674297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.696091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 537/1066] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:23.697935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.712577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.713730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.713730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.714050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.715421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b7bf2693bf6449e487bffeb43d15124b, user.id=ac4ad4ff79c949d2a30c206da5308e4a) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:23.715850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.718208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.738281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 530/1067] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/role_assignments?user.id=ac4ad4ff79c949d2a30c206da5308e4a&scope.project.id=b7bf2693bf6449e487bffeb43d15124b&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:23.786086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:23.832619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:23.852231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e1df1-26e8-4d80-accc-90631a237407 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:23.895970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:23.896648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:23.896929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:23.898291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/3a545f5fde0d432fbe31819eb5c7c39d/roles/a91f53910bb54ad89e16e189ca168db0` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:23.900087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=3a545f5fde0d432fbe31819eb5c7c39d, role_id=a91f53910bb54ad89e16e189ca168db0)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:23.901641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:23.918175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 538/1068] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:23 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/3a545f5fde0d432fbe31819eb5c7c39d/roles/a91f53910bb54ad89e16e189ca168db0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:03:23.973951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2944c-b69c-4265-a93e-968030335d36 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.040571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.041209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.041571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.041894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] PATH_INFO: `/v3/services/image` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.042554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.044303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:24.063938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:24.065302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 08:03:24.066202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:24.071444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 531/1069] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Sep 1 08:03:23 2022] GET /identity/v3/services/image => generated 86 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:24.076602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.105352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.201778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105ac1-c959-4364-a033-0fa909d60dca None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.254921 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712d117-b01e-429b-9770-518362145d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.255541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712d117-b01e-429b-9770-518362145d47 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.255816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712d117-b01e-429b-9770-518362145d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.256084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712d117-b01e-429b-9770-518362145d47 None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.256717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712d117-b01e-429b-9770-518362145d47 None admin] RBAC: Adding query filter params (name=image) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:24.257013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712d117-b01e-429b-9770-518362145d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.258719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712d117-b01e-429b-9770-518362145d47 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.266406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 539/1070] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:24.271289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.397848 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.412793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f3311-88ad-4e06-bd5f-06de7e96601c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.477641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa01026-6d6e-4188-98a6-33c3b4233d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.478725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa01026-6d6e-4188-98a6-33c3b4233d17 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.479202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa01026-6d6e-4188-98a6-33c3b4233d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.479699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa01026-6d6e-4188-98a6-33c3b4233d17 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.480896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa01026-6d6e-4188-98a6-33c3b4233d17 None admin] RBAC: Adding query filter params (type=image) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:24.481421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa01026-6d6e-4188-98a6-33c3b4233d17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.484824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa01026-6d6e-4188-98a6-33c3b4233d17 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.496159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 532/1071] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:24.497620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712d117-b01e-429b-9770-518362145d47 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:24.631933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:24.655865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712d117-b01e-429b-9770-518362145d47 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:24.695851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820ca44-a77e-4b2f-84de-a2a94128d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:24.696460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ca44-a77e-4b2f-84de-a2a94128d6c2 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:24.696729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ca44-a77e-4b2f-84de-a2a94128d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:24.696991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820ca44-a77e-4b2f-84de-a2a94128d6c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:24.697647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820ca44-a77e-4b2f-84de-a2a94128d6c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:24.699059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820ca44-a77e-4b2f-84de-a2a94128d6c2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:24.728532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 540/1072] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:03:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:25.764345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64877-d26c-475e-b371-3a9ca9d1543d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.764987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64877-d26c-475e-b371-3a9ca9d1543d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.765300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64877-d26c-475e-b371-3a9ca9d1543d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.767750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 533/1073] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:25.774614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d464d-5447-4fe3-b252-d2e7c7dfb881 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.775236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d464d-5447-4fe3-b252-d2e7c7dfb881 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.775568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d464d-5447-4fe3-b252-d2e7c7dfb881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.798473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b99d464d-5447-4fe3-b252-d2e7c7dfb881 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:25.799916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b99d464d-5447-4fe3-b252-d2e7c7dfb881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:25.909372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 541/1074] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:25.987566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3c713-b700-4552-a5b7-f3ae4a481926 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.988089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3c713-b700-4552-a5b7-f3ae4a481926 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.988559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3c713-b700-4552-a5b7-f3ae4a481926 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:25.991265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 534/1075] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:25.997360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d7ad7-bbe7-4730-8454-30dd86fa4d29 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:25.997755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d7ad7-bbe7-4730-8454-30dd86fa4d29 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:25.997930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d7ad7-bbe7-4730-8454-30dd86fa4d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.020715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f82d7ad7-bbe7-4730-8454-30dd86fa4d29 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:26.022212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f82d7ad7-bbe7-4730-8454-30dd86fa4d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:26.108984 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:26.123672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 542/1076] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:26.258228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3c713-b700-4552-a5b7-f3ae4a481926 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:26.429986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3c713-b700-4552-a5b7-f3ae4a481926 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:26.484927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:26.485863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:26.486383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:26.486853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.505446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:26.514375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:26.516256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:26.517117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:26.522600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 535/1077] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:26.526525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d7ad7-bbe7-4730-8454-30dd86fa4d29 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:26.610814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:26.632415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:26.690685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d7ad7-bbe7-4730-8454-30dd86fa4d29 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:26.749907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:26.751288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:26.751933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:26.752779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.754266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:26.754678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:26.756120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:26.767460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 543/1078] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:26.774501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:26.775124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280e38d-7b54-4d4b-afe4-8b51642fc657 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:26.819438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:26.820080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:26.820357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:26.820628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.834754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:26.839745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:26.841549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:26.844592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 536/1079] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Sep 1 08:03:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:26.847654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:26.851120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:26.918493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878ed1-aea2-499d-9e02-114312c2acac None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:26.944917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:26.961296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b2fb1-0bf2-4c1e-a4de-1a9fae1cd649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:26.962357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2fb1-0bf2-4c1e-a4de-1a9fae1cd649 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:26.962892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2fb1-0bf2-4c1e-a4de-1a9fae1cd649 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:26.963379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b2fb1-0bf2-4c1e-a4de-1a9fae1cd649 None admin] PATH_INFO: `/v3/users/ac4ad4ff79c949d2a30c206da5308e4a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.965335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b2fb1-0bf2-4c1e-a4de-1a9fae1cd649 None admin] RBAC: Authorizing `identity:get_user(user_id=ac4ad4ff79c949d2a30c206da5308e4a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:26.968207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b2fb1-0bf2-4c1e-a4de-1a9fae1cd649 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:26.973577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 544/1080] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:26 2022] GET /identity/v3/users/ac4ad4ff79c949d2a30c206da5308e4a => generated 285 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:26.973778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e33b72-2114-4cdb-919a-a71488bab57e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:26.973865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27fc10-82a8-4781-aa2b-f50d14c628e7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:26.973865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27fc10-82a8-4781-aa2b-f50d14c628e7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:26.974092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27fc10-82a8-4781-aa2b-f50d14c628e7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:26.976161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 545/1081] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:26.977558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27fc10-82a8-4781-aa2b-f50d14c628e7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.013778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e823e-8a93-4fca-9327-34dd868875c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.014426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e823e-8a93-4fca-9327-34dd868875c9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.015473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e823e-8a93-4fca-9327-34dd868875c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.015632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e823e-8a93-4fca-9327-34dd868875c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.016191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e823e-8a93-4fca-9327-34dd868875c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:27.016485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e823e-8a93-4fca-9327-34dd868875c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.017946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e823e-8a93-4fca-9327-34dd868875c9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.035088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 537/1082] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Sep 1 08:03:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:27.035088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9989-a3d8-445a-b88c-627c2dc4eacc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.035088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9989-a3d8-445a-b88c-627c2dc4eacc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.035088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9989-a3d8-445a-b88c-627c2dc4eacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.049584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7fec9989-a3d8-445a-b88c-627c2dc4eacc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:27.050925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7fec9989-a3d8-445a-b88c-627c2dc4eacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:27.102542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27fc10-82a8-4781-aa2b-f50d14c628e7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.123311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 538/1083] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:27.125204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9989-a3d8-445a-b88c-627c2dc4eacc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.143535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.160546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.161547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.162081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.162428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.164456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] RBAC: Authorizing `identity:get_project(project_id=b7bf2693bf6449e487bffeb43d15124b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.167256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.177520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 546/1084] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:26 2022] GET /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:27.179029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.215078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.262503 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9989-a3d8-445a-b88c-627c2dc4eacc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.305819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.306130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd36d-9e51-4dc2-8cb7-17ab26d7cf38 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.306539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.306880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.307208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.320960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.322961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:27.340878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:27.342632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:27.344802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:27.344802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:27.344802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:27.344802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 539/1085] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:27.349592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.356319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.357393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.357670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.357999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b/users/ac4ad4ff79c949d2a30c206da5308e4a/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.360409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7bf2693bf6449e487bffeb43d15124b, user_id=ac4ad4ff79c949d2a30c206da5308e4a, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.362276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.394291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 547/1086] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:27 2022] PUT /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b/users/ac4ad4ff79c949d2a30c206da5308e4a/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:03:27.401277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.474934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.478558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88386a9-655e-4bd8-9c13-52f34a7af79a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.500221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.535876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.536694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.537135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.537471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.538377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:27.538854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.540518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.545323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a19f8-01a0-490e-b214-952f89b88747 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.562647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 540/1087] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:27.571565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.616994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.617946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.618454 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.618757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.708837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a33-1f1e-4b09-8495-fc13ca40ff9f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:27.733383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.735541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.771342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:27.772012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:27.772287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:27.772553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:27.783193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:27.784840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:03:27.798720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:27.799953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:27.801300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 541/1088] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:27.806480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.824096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.860655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:27.892434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 548/1089] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 08:03:27.898326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:27.946159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e06a7-104c-4261-a0c1-ce68dbe37fdd None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.004545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.005266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.005541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.005815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.006563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:28.006854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.008290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.023487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849704e-f8c9-4fd5-8f3a-bef5c910109d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.032662 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 542/1090] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:28.038644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.068461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.069073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.069346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.069611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.083263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.084881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:28.104193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:28.106080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:28.107365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:28.107365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:28.107365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:28.107365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 549/1091] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:03:28.112437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.123070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.159805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.168371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027881-82df-4c74-9b12-54219a1feecb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.212130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.212750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.213028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.213302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.255145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03955ce2-e5c0-4618-a609-a1ee8a485307 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.299501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.300117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.300397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.300717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.301301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:28.301595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.303024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.322315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 550/1092] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:28.339117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.340532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.472174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.482907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 543/1093] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 08:03:28.489374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.598877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:28.669372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abdd78-5628-4c4f-bad9-7353848d4b4e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.735460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.736568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.737064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.737553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.758569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.761352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:03:28.792095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:28.793224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:03:28.794105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:03:28.794105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:03:28.794105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:28.794316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 551/1094] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:28.803475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:28.939406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6132fe-5209-476f-81a1-2ed99b4c2652 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:28.977811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:28.978454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:28.978742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:28.979012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:28.979672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:28.979975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:28.981357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:28.994582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 544/1095] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:29.003093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:29.128285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee2394-7ce3-4748-bcca-579b3afde992 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:29.148137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:29.169025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:29.169946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:29.170442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:29.170762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:29.181537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:29.183997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:03:29.199053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:29.199974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:29.200875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 552/1096] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:29.206813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:29.268598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:29.314723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78ddf5-ecd7-4866-a837-519b62176eac None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:29.348939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d241c-abe9-49fd-b0e2-db05d2ae309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:29.349539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d241c-abe9-49fd-b0e2-db05d2ae309f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:29.349996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d241c-abe9-49fd-b0e2-db05d2ae309f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:29.350297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d241c-abe9-49fd-b0e2-db05d2ae309f None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:29.350993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d241c-abe9-49fd-b0e2-db05d2ae309f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:29.351291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d241c-abe9-49fd-b0e2-db05d2ae309f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:29.352711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d241c-abe9-49fd-b0e2-db05d2ae309f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:29.365294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 545/1097] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:29.371340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:29.482228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f90391-c73f-40dd-8342-16e190e09e6e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:29.517697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc81ac6-48ae-4ae0-b703-8dcd3ead5ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:29.518320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81ac6-48ae-4ae0-b703-8dcd3ead5ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:29.518597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81ac6-48ae-4ae0-b703-8dcd3ead5ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:29.518863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc81ac6-48ae-4ae0-b703-8dcd3ead5ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:29.519589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc81ac6-48ae-4ae0-b703-8dcd3ead5ae6 None admin] RBAC: Adding query filter params (role.id=a91f53910bb54ad89e16e189ca168db0, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=3a545f5fde0d432fbe31819eb5c7c39d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:29.519888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc81ac6-48ae-4ae0-b703-8dcd3ead5ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:29.521307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc81ac6-48ae-4ae0-b703-8dcd3ead5ae6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:29.527481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 553/1098] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:29 2022] GET /identity/v3/role_assignments?user.id=3a545f5fde0d432fbe31819eb5c7c39d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=a91f53910bb54ad89e16e189ca168db0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:29.540617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266166-5cb3-4918-b8e8-e10b7d27b262 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:29.540952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266166-5cb3-4918-b8e8-e10b7d27b262 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:29.541265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266166-5cb3-4918-b8e8-e10b7d27b262 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:29.542819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 546/1099] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:29.549396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7619c-8cc2-4d97-9640-1a32c4c126af None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:29.549732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7619c-8cc2-4d97-9640-1a32c4c126af None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:29.550102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7619c-8cc2-4d97-9640-1a32c4c126af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:29.570412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-53c7619c-8cc2-4d97-9640-1a32c4c126af None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:29.571631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-53c7619c-8cc2-4d97-9640-1a32c4c126af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:29.618924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:29.657342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 554/1100] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:29.930747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266166-5cb3-4918-b8e8-e10b7d27b262 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:30.042083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266166-5cb3-4918-b8e8-e10b7d27b262 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:30.060854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:30.082055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:30.083170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.083628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.084082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.097652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:30.102612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:30.103622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:30.104454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 547/1101] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:30.110810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7619c-8cc2-4d97-9640-1a32c4c126af None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:30.224808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7619c-8cc2-4d97-9640-1a32c4c126af None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:30.261716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:30.262364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.262645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.262914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.263589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:30.263891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:30.269030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:30.279283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 555/1102] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:30.286318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:30.402434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913d86c-d70b-4eb9-98c5-bd77ecce59c5 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:30.442654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:30.443290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.443568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.443842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] PATH_INFO: `/v3/users/ac4ad4ff79c949d2a30c206da5308e4a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.445015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] RBAC: Authorizing `identity:get_user(user_id=ac4ad4ff79c949d2a30c206da5308e4a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:30.446548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:30.448162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 548/1103] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:30 2022] GET /identity/v3/users/ac4ad4ff79c949d2a30c206da5308e4a => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:30.455854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:30.493986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:30.565691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814d2b3-b929-4768-a106-54a965127824 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:30.607331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:30.607951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:30.608229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:30.608541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:30.681814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:30.683322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:30.717261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:30.788743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 556/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:30.798398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:30.878398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:30.970999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9432cca-d115-4850-8c38-b8b117f8b141 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.028870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbcc2a-83ba-4ce5-baf9-4d6a6083c59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.029846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcc2a-83ba-4ce5-baf9-4d6a6083c59e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.030899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcc2a-83ba-4ce5-baf9-4d6a6083c59e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.031653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbcc2a-83ba-4ce5-baf9-4d6a6083c59e None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.033334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcc2a-83ba-4ce5-baf9-4d6a6083c59e None admin] RBAC: Authorizing `identity:get_project(project_id=b7bf2693bf6449e487bffeb43d15124b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.035951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbcc2a-83ba-4ce5-baf9-4d6a6083c59e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.039232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 549/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:30 2022] GET /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b => generated 311 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:31.045443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:31.154203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de885a-422c-4847-b838-d60855cccc47 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:31.192053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873390-7e4e-4a7c-be46-253b987199a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:31.192657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873390-7e4e-4a7c-be46-253b987199a9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:31.192935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873390-7e4e-4a7c-be46-253b987199a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:31.193205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873390-7e4e-4a7c-be46-253b987199a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:31.193934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873390-7e4e-4a7c-be46-253b987199a9 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b7bf2693bf6449e487bffeb43d15124b, user.id=ac4ad4ff79c949d2a30c206da5308e4a) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:31.194273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873390-7e4e-4a7c-be46-253b987199a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:31.195702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873390-7e4e-4a7c-be46-253b987199a9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:31.197655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:31.202358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 557/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:31 2022] GET /identity/v3/role_assignments?user.id=ac4ad4ff79c949d2a30c206da5308e4a&scope.project.id=b7bf2693bf6449e487bffeb43d15124b&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:33.917508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f832-3d72-4397-b2aa-529f2c3e70c3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:33.918007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f832-3d72-4397-b2aa-529f2c3e70c3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:33.918445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3f832-3d72-4397-b2aa-529f2c3e70c3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:33.921558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 550/1107] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:33.927288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591f0cd-b335-4004-a520-032ba943ba04 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:33.927746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591f0cd-b335-4004-a520-032ba943ba04 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:33.927858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591f0cd-b335-4004-a520-032ba943ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:33.946657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8591f0cd-b335-4004-a520-032ba943ba04 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:33.947874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8591f0cd-b335-4004-a520-032ba943ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:34.017145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 558/1108] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:34.290375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3f832-3d72-4397-b2aa-529f2c3e70c3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.412981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3f832-3d72-4397-b2aa-529f2c3e70c3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.429419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:34.455351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e24d6-8137-42fc-8379-8b250f0e8339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.456018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e24d6-8137-42fc-8379-8b250f0e8339 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.456301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e24d6-8137-42fc-8379-8b250f0e8339 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.456576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e24d6-8137-42fc-8379-8b250f0e8339 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.457858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e24d6-8137-42fc-8379-8b250f0e8339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.459388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e24d6-8137-42fc-8379-8b250f0e8339 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.461110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 551/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:34.467541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591f0cd-b335-4004-a520-032ba943ba04 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:34.604267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591f0cd-b335-4004-a520-032ba943ba04 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:34.632514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:34.642193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a557ea8-9c9c-4def-9868-c10e5ba71a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:34.642835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557ea8-9c9c-4def-9868-c10e5ba71a0a None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:34.643112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557ea8-9c9c-4def-9868-c10e5ba71a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:34.643377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a557ea8-9c9c-4def-9868-c10e5ba71a0a None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:34.644049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a557ea8-9c9c-4def-9868-c10e5ba71a0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:34.645477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a557ea8-9c9c-4def-9868-c10e5ba71a0a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:34.667491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 559/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:03:34 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:36.702775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043250fd-ebef-4ff8-9ff2-a5461c678165 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.703444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043250fd-ebef-4ff8-9ff2-a5461c678165 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.703444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043250fd-ebef-4ff8-9ff2-a5461c678165 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.704642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 552/1111] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:36.710203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a51f1-377d-42e1-932b-26bfd71d474f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:36.710710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a51f1-377d-42e1-932b-26bfd71d474f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:36.710799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a51f1-377d-42e1-932b-26bfd71d474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:36.735098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b30a51f1-377d-42e1-932b-26bfd71d474f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:36.736397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b30a51f1-377d-42e1-932b-26bfd71d474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:36.812696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 560/1112] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:37.079008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043250fd-ebef-4ff8-9ff2-a5461c678165 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.194841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043250fd-ebef-4ff8-9ff2-a5461c678165 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.230889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.231934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.232210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.232485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] PATH_INFO: `/v3/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.236260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] RBAC: Authorizing `identity:get_role(role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.237661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.239079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 553/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:37.245291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a51f1-377d-42e1-932b-26bfd71d474f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.364799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a51f1-377d-42e1-932b-26bfd71d474f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.381671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.403929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.404572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.405117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.407363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] PATH_INFO: `/v3/users/745f69a84618461fb471106d1a871b6e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.423060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] RBAC: Authorizing `identity:get_user(user_id=745f69a84618461fb471106d1a871b6e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.424668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.426631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 561/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/users/745f69a84618461fb471106d1a871b6e => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:37.433149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.495320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.557195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479118-7f82-41a6-811a-02444df227e4 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.603350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.604007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.604337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.604645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.674735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.676094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.725179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:37.780525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 554/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:37.786790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:37.891723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32546f4-a892-4b3c-b473-ec3c6168def2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:37.927783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda6096-077a-4a11-85cd-4ededaaad1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:37.928342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6096-077a-4a11-85cd-4ededaaad1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:37.928619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6096-077a-4a11-85cd-4ededaaad1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:37.928892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda6096-077a-4a11-85cd-4ededaaad1e1 None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:37.930010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6096-077a-4a11-85cd-4ededaaad1e1 None admin] RBAC: Authorizing `identity:get_project(project_id=b7bf2693bf6449e487bffeb43d15124b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:37.931478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda6096-077a-4a11-85cd-4ededaaad1e1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:37.933159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 562/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:37.940125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:38.047655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c806be3-ba76-4062-a7db-21fe2509231a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:38.084798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271727ca-d992-4d77-9577-8cd1c2233f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:38.085407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271727ca-d992-4d77-9577-8cd1c2233f8e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:38.085831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271727ca-d992-4d77-9577-8cd1c2233f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:38.086081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271727ca-d992-4d77-9577-8cd1c2233f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:38.086856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271727ca-d992-4d77-9577-8cd1c2233f8e None admin] RBAC: Adding query filter params (role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=b7bf2693bf6449e487bffeb43d15124b, user.id=745f69a84618461fb471106d1a871b6e) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:38.087164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271727ca-d992-4d77-9577-8cd1c2233f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:38.088621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271727ca-d992-4d77-9577-8cd1c2233f8e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:38.095201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 555/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:37 2022] GET /identity/v3/role_assignments?user.id=745f69a84618461fb471106d1a871b6e&scope.project.id=b7bf2693bf6449e487bffeb43d15124b&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:40.017086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431aa16-f376-4ea6-9974-70982b0252ed None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.017625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431aa16-f376-4ea6-9974-70982b0252ed None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.017625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431aa16-f376-4ea6-9974-70982b0252ed None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.019000 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 563/1118] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:40.024719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425d6a4-ec31-4c19-9802-ce34bf75e4c7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.025151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425d6a4-ec31-4c19-9802-ce34bf75e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.025584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425d6a4-ec31-4c19-9802-ce34bf75e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.054625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4425d6a4-ec31-4c19-9802-ce34bf75e4c7 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:40.056684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4425d6a4-ec31-4c19-9802-ce34bf75e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:40.068107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.132827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 556/1119] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:03:40.401695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431aa16-f376-4ea6-9974-70982b0252ed None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.448520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.508227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431aa16-f376-4ea6-9974-70982b0252ed None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.545157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.545949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.546223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.546517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] PATH_INFO: `/v3/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.547923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] RBAC: Authorizing `identity:get_role(role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.549285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.550671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 564/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:40.556804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425d6a4-ec31-4c19-9802-ce34bf75e4c7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.662211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425d6a4-ec31-4c19-9802-ce34bf75e4c7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.697584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.698220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.698534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.698808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] PATH_INFO: `/v3/users/745f69a84618461fb471106d1a871b6e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.699950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] RBAC: Authorizing `identity:get_user(user_id=745f69a84618461fb471106d1a871b6e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.701389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.703382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 557/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/users/745f69a84618461fb471106d1a871b6e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:40.709433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.812168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c63f0-c2a2-4af7-b981-62d3b26bc59b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:40.822803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.849102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de9483-0981-440c-8076-5f93bd11f479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:40.849732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de9483-0981-440c-8076-5f93bd11f479 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:40.850001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de9483-0981-440c-8076-5f93bd11f479 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:40.850288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de9483-0981-440c-8076-5f93bd11f479 None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:40.851410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de9483-0981-440c-8076-5f93bd11f479 None admin] RBAC: Authorizing `identity:get_project(project_id=b7bf2693bf6449e487bffeb43d15124b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:40.852828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de9483-0981-440c-8076-5f93bd11f479 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:40.854487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 565/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:40 2022] GET /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:40.861628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:40.877681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:40.979264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426af3d-064a-4c59-bdf9-2615acbe2866 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:41.016931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f116e-1190-4dee-8920-7269908f822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:41.017639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f116e-1190-4dee-8920-7269908f822b None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:41.017915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f116e-1190-4dee-8920-7269908f822b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:41.018186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f116e-1190-4dee-8920-7269908f822b None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b/users/745f69a84618461fb471106d1a871b6e/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:41.020383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f116e-1190-4dee-8920-7269908f822b None admin] RBAC: Authorizing `identity:create_grant(project_id=b7bf2693bf6449e487bffeb43d15124b, user_id=745f69a84618461fb471106d1a871b6e, role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:41.021813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f116e-1190-4dee-8920-7269908f822b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:41.036499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 558/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:40 2022] PUT /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b/users/745f69a84618461fb471106d1a871b6e/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:03:43.039228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3441-416e-465c-a509-d9ad7216fc12 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.039761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3441-416e-465c-a509-d9ad7216fc12 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.039882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b3441-416e-465c-a509-d9ad7216fc12 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.041280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 566/1124] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:43.047325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833caf-3c4a-418e-903c-c89304989215 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.047781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833caf-3c4a-418e-903c-c89304989215 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.047872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9833caf-3c4a-418e-903c-c89304989215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.067275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a9833caf-3c4a-418e-903c-c89304989215 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:43.068472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a9833caf-3c4a-418e-903c-c89304989215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:43.133375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:43.139000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 559/1125] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:43.415468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3441-416e-465c-a509-d9ad7216fc12 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:43.519202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b3441-416e-465c-a509-d9ad7216fc12 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:43.554412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:43.555047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.555327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.555597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] PATH_INFO: `/v3/roles/4e20ba746ff84067b2656cf3776e75f4` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.557001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] RBAC: Authorizing `identity:get_role(role_id=4e20ba746ff84067b2656cf3776e75f4)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:43.558410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:43.559761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 567/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:43 2022] GET /identity/v3/roles/4e20ba746ff84067b2656cf3776e75f4 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:43.569683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9833caf-3c4a-418e-903c-c89304989215 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:43.680297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9833caf-3c4a-418e-903c-c89304989215 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:43.718650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:43.719285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.719567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.719841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] PATH_INFO: `/v3/users/745f69a84618461fb471106d1a871b6e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.720987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] RBAC: Authorizing `identity:get_user(user_id=745f69a84618461fb471106d1a871b6e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:43.722452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:43.724059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 560/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:43 2022] GET /identity/v3/users/745f69a84618461fb471106d1a871b6e => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:43.730205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:43.777435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:43.833896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55c644-700d-41cd-b727-6147cf31334d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:43.869208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:43.869816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:43.870094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:43.870392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:43.939121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:43.940478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:43.985423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:44.046483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 568/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:44.052571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.122160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:44.158440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40673ca-60ee-45e2-9014-6e127d8ea667 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.193262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e611a73-dd9d-474e-bb2f-a6015568e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.193793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611a73-dd9d-474e-bb2f-a6015568e80c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.194066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611a73-dd9d-474e-bb2f-a6015568e80c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.194367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611a73-dd9d-474e-bb2f-a6015568e80c None admin] PATH_INFO: `/v3/projects/b7bf2693bf6449e487bffeb43d15124b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.195475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e611a73-dd9d-474e-bb2f-a6015568e80c None admin] RBAC: Authorizing `identity:get_project(project_id=b7bf2693bf6449e487bffeb43d15124b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.196914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e611a73-dd9d-474e-bb2f-a6015568e80c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:44.198582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 561/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:44 2022] GET /identity/v3/projects/b7bf2693bf6449e487bffeb43d15124b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:44.205004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:44.310108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44dfd-2d0d-4406-ac9e-85f51d71d5b9 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:44.366464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde7f78-1d5d-4ba0-a4a9-8b5e270d5204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:44.367087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7f78-1d5d-4ba0-a4a9-8b5e270d5204 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:44.367364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7f78-1d5d-4ba0-a4a9-8b5e270d5204 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:44.367635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde7f78-1d5d-4ba0-a4a9-8b5e270d5204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:44.368381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde7f78-1d5d-4ba0-a4a9-8b5e270d5204 None admin] RBAC: Adding query filter params (role.id=4e20ba746ff84067b2656cf3776e75f4, scope.project.id=b7bf2693bf6449e487bffeb43d15124b, user.id=745f69a84618461fb471106d1a871b6e) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:44.368676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde7f78-1d5d-4ba0-a4a9-8b5e270d5204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:44.370124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde7f78-1d5d-4ba0-a4a9-8b5e270d5204 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:44.377796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 569/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:44 2022] GET /identity/v3/role_assignments?user.id=745f69a84618461fb471106d1a871b6e&scope.project.id=b7bf2693bf6449e487bffeb43d15124b&role.id=4e20ba746ff84067b2656cf3776e75f4 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:46.390370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3658-7f02-40f0-a392-682bc2af8d7f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.391027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3658-7f02-40f0-a392-682bc2af8d7f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.391027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3658-7f02-40f0-a392-682bc2af8d7f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.392247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 562/1131] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:46.398756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21052fc-9a6e-4446-b2d8-e2702a30be97 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.399243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21052fc-9a6e-4446-b2d8-e2702a30be97 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.399335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21052fc-9a6e-4446-b2d8-e2702a30be97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.418021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f21052fc-9a6e-4446-b2d8-e2702a30be97 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:46.419267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f21052fc-9a6e-4446-b2d8-e2702a30be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:46.422528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:46.496126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 570/1132] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:46.767969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e3658-7f02-40f0-a392-682bc2af8d7f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:46.878485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e3658-7f02-40f0-a392-682bc2af8d7f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:46.915832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7679ce8-8c94-46ae-b4e2-1b579d6bdb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:46.916470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7679ce8-8c94-46ae-b4e2-1b579d6bdb44 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:46.916752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7679ce8-8c94-46ae-b4e2-1b579d6bdb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:46.917027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7679ce8-8c94-46ae-b4e2-1b579d6bdb44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:46.918170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7679ce8-8c94-46ae-b4e2-1b579d6bdb44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:46.919741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7679ce8-8c94-46ae-b4e2-1b579d6bdb44 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:46.922399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 563/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:03:46.928636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21052fc-9a6e-4446-b2d8-e2702a30be97 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:47.035286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21052fc-9a6e-4446-b2d8-e2702a30be97 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:47.071822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146f5ae-6aa3-4b5d-8b7a-3bd1387ee7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:47.072436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f5ae-6aa3-4b5d-8b7a-3bd1387ee7af None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:47.072714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f5ae-6aa3-4b5d-8b7a-3bd1387ee7af None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:47.072989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f5ae-6aa3-4b5d-8b7a-3bd1387ee7af None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:47.073638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146f5ae-6aa3-4b5d-8b7a-3bd1387ee7af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:47.075112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146f5ae-6aa3-4b5d-8b7a-3bd1387ee7af None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:47.086033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:47.106770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 571/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:03:46 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:49.118979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e23a3-f792-4917-9d8a-74be59f3279f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:49.119529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e23a3-f792-4917-9d8a-74be59f3279f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:49.119529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e23a3-f792-4917-9d8a-74be59f3279f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:49.120840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 564/1135] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:49.126767 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abb0b0-f53f-4d88-a0de-f8e36c160424 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:49.127170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abb0b0-f53f-4d88-a0de-f8e36c160424 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:49.127315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abb0b0-f53f-4d88-a0de-f8e36c160424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:49.145756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-39abb0b0-f53f-4d88-a0de-f8e36c160424 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:49.146987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-39abb0b0-f53f-4d88-a0de-f8e36c160424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:49.212745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 572/1136] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:49.489461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e23a3-f792-4917-9d8a-74be59f3279f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:49.493199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:49.588781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e23a3-f792-4917-9d8a-74be59f3279f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:49.624412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700a121-fedb-4202-9929-8a35b28aa6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:49.625031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a121-fedb-4202-9929-8a35b28aa6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:49.625304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a121-fedb-4202-9929-8a35b28aa6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:49.625573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700a121-fedb-4202-9929-8a35b28aa6f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:49.626757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700a121-fedb-4202-9929-8a35b28aa6f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:49.628180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700a121-fedb-4202-9929-8a35b28aa6f7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:49.629742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 565/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:03:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:49.635712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abb0b0-f53f-4d88-a0de-f8e36c160424 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:49.734973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abb0b0-f53f-4d88-a0de-f8e36c160424 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:49.756227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:49.772040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ee205-9ed7-411f-9947-1a74a4e41834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:49.772649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee205-9ed7-411f-9947-1a74a4e41834 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:49.772930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee205-9ed7-411f-9947-1a74a4e41834 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:49.773206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee205-9ed7-411f-9947-1a74a4e41834 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:49.773868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ee205-9ed7-411f-9947-1a74a4e41834 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:49.775376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ee205-9ed7-411f-9947-1a74a4e41834 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:49.797620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 573/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:03:49 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:03:51.800325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5d08-b122-4985-bfca-ce7e8784b0a2 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:51.800841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5d08-b122-4985-bfca-ce7e8784b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:51.800946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5d08-b122-4985-bfca-ce7e8784b0a2 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:51.802195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 566/1139] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:51.807658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62750-6de2-4cb3-9934-495c08232e5f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:51.808043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62750-6de2-4cb3-9934-495c08232e5f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:51.808207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d62750-6de2-4cb3-9934-495c08232e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:51.827189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-03d62750-6de2-4cb3-9934-495c08232e5f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:51.828379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-03d62750-6de2-4cb3-9934-495c08232e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:51.894914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 574/1140] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:52.169058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5d08-b122-4985-bfca-ce7e8784b0a2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:52.239462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:52.269974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5d08-b122-4985-bfca-ce7e8784b0a2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:52.303260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:52.303879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:52.304160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:52.304435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:52.314995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:52.319774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:52.320950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:52.322040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 567/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:52.327358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62750-6de2-4cb3-9934-495c08232e5f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:52.431765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d62750-6de2-4cb3-9934-495c08232e5f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:52.440202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:52.472540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:52.473151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:52.473431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:52.473704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:52.474416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:52.474722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:52.476097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:52.484801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 575/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:52.491239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:52.593678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1731699-11cc-42cb-922e-e8a02e3791bc None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:52.624527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:52.629904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:52.630560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:52.630842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:52.631119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] PATH_INFO: `/v3/users/54e714ebac5d4f5f8d756c2ec1f73ecc` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:52.644583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] RBAC: Authorizing `identity:get_user(user_id=54e714ebac5d4f5f8d756c2ec1f73ecc)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:52.646025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:52.647651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 568/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:52 2022] GET /identity/v3/users/54e714ebac5d4f5f8d756c2ec1f73ecc => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:52.653815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:52.752225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f779f8-e0ed-4dc1-84a3-210b22c9a20d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:52.785681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:52.786306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:52.786584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:52.786853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:52.820787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:52.854488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:52.855943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:52.954182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 576/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:52.960283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:53.067036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fffbb-2e3c-4130-a753-0d15ee70510f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:53.115909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c39f01-c5ed-471d-a416-04f788bd8bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:53.116531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39f01-c5ed-471d-a416-04f788bd8bae None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:53.116806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39f01-c5ed-471d-a416-04f788bd8bae None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:53.117073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c39f01-c5ed-471d-a416-04f788bd8bae None admin] PATH_INFO: `/v3/projects/39e5bd1efab744a280b2f054ecdc5883` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:53.118174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c39f01-c5ed-471d-a416-04f788bd8bae None admin] RBAC: Authorizing `identity:get_project(project_id=39e5bd1efab744a280b2f054ecdc5883)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:53.119615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c39f01-c5ed-471d-a416-04f788bd8bae None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:53.121239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 569/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:52 2022] GET /identity/v3/projects/39e5bd1efab744a280b2f054ecdc5883 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:53.128111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:53.193813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:53.229009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b00f0-78ca-4195-aa40-e8bd448344e3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:53.263029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fda487-dcef-4aa1-839f-c72b1baa8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:53.263629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fda487-dcef-4aa1-839f-c72b1baa8cec None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:53.264500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fda487-dcef-4aa1-839f-c72b1baa8cec None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:53.264776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fda487-dcef-4aa1-839f-c72b1baa8cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:53.265497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fda487-dcef-4aa1-839f-c72b1baa8cec None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=39e5bd1efab744a280b2f054ecdc5883, user.id=54e714ebac5d4f5f8d756c2ec1f73ecc) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:53.265799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fda487-dcef-4aa1-839f-c72b1baa8cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:53.267267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fda487-dcef-4aa1-839f-c72b1baa8cec None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:53.272969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 577/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:53 2022] GET /identity/v3/role_assignments?user.id=54e714ebac5d4f5f8d756c2ec1f73ecc&scope.project.id=39e5bd1efab744a280b2f054ecdc5883&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:55.181250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2300f-375e-49fb-9c50-62e20363506f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:55.181855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2300f-375e-49fb-9c50-62e20363506f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:55.181855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2300f-375e-49fb-9c50-62e20363506f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:55.183153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 570/1147] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:55.189122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308abf-dca8-4fc8-8f8c-7c79ed1c8b92 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:55.189547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308abf-dca8-4fc8-8f8c-7c79ed1c8b92 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:55.189663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308abf-dca8-4fc8-8f8c-7c79ed1c8b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:55.208128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-88308abf-dca8-4fc8-8f8c-7c79ed1c8b92 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:55.209312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-88308abf-dca8-4fc8-8f8c-7c79ed1c8b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:55.277780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 578/1148] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:55.551163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2300f-375e-49fb-9c50-62e20363506f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:55.613983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:55.658230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2300f-375e-49fb-9c50-62e20363506f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:55.695128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:55.695751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:55.696036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:55.696311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:55.706806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:55.711551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:55.712603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:03:55.713613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 571/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:55.718843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308abf-dca8-4fc8-8f8c-7c79ed1c8b92 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:55.777660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:55.814992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308abf-dca8-4fc8-8f8c-7c79ed1c8b92 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:55.848413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:55.849006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:55.849281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:55.849546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:55.850193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:55.850520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:55.851867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:55.860576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 579/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:55.866502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:55.964068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc4368-b45d-4cc0-8b7d-f55d638bb44e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:55.984920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:56.001750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:56.002431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:56.002688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:56.002955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] PATH_INFO: `/v3/users/54e714ebac5d4f5f8d756c2ec1f73ecc` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:56.004066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] RBAC: Authorizing `identity:get_user(user_id=54e714ebac5d4f5f8d756c2ec1f73ecc)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:56.005493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:56.007088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 572/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:55 2022] GET /identity/v3/users/54e714ebac5d4f5f8d756c2ec1f73ecc => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:56.012888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:56.114882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41c90a-5d26-444a-aecd-bd3a4ff3e10d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:56.137871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:56.149300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b2e3b-4a88-40ee-b92b-5cee20de4c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:56.149922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2e3b-4a88-40ee-b92b-5cee20de4c05 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:56.150194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2e3b-4a88-40ee-b92b-5cee20de4c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:56.150494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b2e3b-4a88-40ee-b92b-5cee20de4c05 None admin] PATH_INFO: `/v3/projects/39e5bd1efab744a280b2f054ecdc5883` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:56.151593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b2e3b-4a88-40ee-b92b-5cee20de4c05 None admin] RBAC: Authorizing `identity:get_project(project_id=39e5bd1efab744a280b2f054ecdc5883)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:56.153005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b2e3b-4a88-40ee-b92b-5cee20de4c05 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:56.155374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 580/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:56 2022] GET /identity/v3/projects/39e5bd1efab744a280b2f054ecdc5883 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:56.161380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:56.261515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b68eb7-3610-442a-8754-6347a932772c None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:56.295984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea607e25-def4-4b7e-8b8f-aef7e513a982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:56.296636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607e25-def4-4b7e-8b8f-aef7e513a982 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:56.296918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607e25-def4-4b7e-8b8f-aef7e513a982 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:56.297192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea607e25-def4-4b7e-8b8f-aef7e513a982 None admin] PATH_INFO: `/v3/projects/39e5bd1efab744a280b2f054ecdc5883/users/54e714ebac5d4f5f8d756c2ec1f73ecc/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:56.299170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea607e25-def4-4b7e-8b8f-aef7e513a982 None admin] RBAC: Authorizing `identity:create_grant(project_id=39e5bd1efab744a280b2f054ecdc5883, user_id=54e714ebac5d4f5f8d756c2ec1f73ecc, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:56.300599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea607e25-def4-4b7e-8b8f-aef7e513a982 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:56.314187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 573/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:03:56 2022] PUT /identity/v3/projects/39e5bd1efab744a280b2f054ecdc5883/users/54e714ebac5d4f5f8d756c2ec1f73ecc/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:03:58.248369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae1892-e018-4df8-8727-8d6c0fabddf7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:58.248895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae1892-e018-4df8-8727-8d6c0fabddf7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:58.248895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae1892-e018-4df8-8727-8d6c0fabddf7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:58.250259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 581/1154] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:03:58.255437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00789-6c5c-40c8-8be7-cd4a898bef59 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:58.255872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00789-6c5c-40c8-8be7-cd4a898bef59 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:58.255998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00789-6c5c-40c8-8be7-cd4a898bef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:58.275303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9fe00789-6c5c-40c8-8be7-cd4a898bef59 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:03:58.276495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9fe00789-6c5c-40c8-8be7-cd4a898bef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:03:58.318961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:58.345154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 574/1155] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:03:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:03:58.616342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae1892-e018-4df8-8727-8d6c0fabddf7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:58.718474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae1892-e018-4df8-8727-8d6c0fabddf7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:58.751689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:58.752312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:58.752599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:58.752869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:58.763100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:03:58.768794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:03:58.769875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:03:58.771144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 582/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:03:58.775998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00789-6c5c-40c8-8be7-cd4a898bef59 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:58.874566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00789-6c5c-40c8-8be7-cd4a898bef59 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:58.908467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:58.909069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:58.909354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:58.909627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:58.910328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:58.910769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:58.912150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:58.921235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 575/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:58.928362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:58.982004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.030554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a362464-3d86-4fd7-85a5-03dc94cf5228 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.063031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.063655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.063929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.064197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] PATH_INFO: `/v3/users/54e714ebac5d4f5f8d756c2ec1f73ecc` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.065913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] RBAC: Authorizing `identity:get_user(user_id=54e714ebac5d4f5f8d756c2ec1f73ecc)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.066850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.068497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 583/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:03:58 2022] GET /identity/v3/users/54e714ebac5d4f5f8d756c2ec1f73ecc => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:59.076733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:59.117884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.179518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b28d5-8e71-4a9c-9487-9b9d36d1ccb9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.213844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.214477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.214755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.215026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.285812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.287294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.328385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.395373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 576/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:03:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:03:59.401934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:59.506894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16290e53-0e08-4bbc-8ea4-bdefddb4dc0a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.526197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:03:59.540826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1fb59-df23-46e7-bc5e-aac4e3199a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.541448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fb59-df23-46e7-bc5e-aac4e3199a8a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.541721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fb59-df23-46e7-bc5e-aac4e3199a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.541985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1fb59-df23-46e7-bc5e-aac4e3199a8a None admin] PATH_INFO: `/v3/projects/39e5bd1efab744a280b2f054ecdc5883` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.543107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1fb59-df23-46e7-bc5e-aac4e3199a8a None admin] RBAC: Authorizing `identity:get_project(project_id=39e5bd1efab744a280b2f054ecdc5883)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.544531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1fb59-df23-46e7-bc5e-aac4e3199a8a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.546828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 584/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:03:59 2022] GET /identity/v3/projects/39e5bd1efab744a280b2f054ecdc5883 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:03:59.553117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:03:59.655656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf18cb-420e-436f-9a1b-710f6dc86d1e None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:03:59.690991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca46a1e-c48d-45fb-afa2-4537d58f2037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:03:59.691592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46a1e-c48d-45fb-afa2-4537d58f2037 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:03:59.691872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46a1e-c48d-45fb-afa2-4537d58f2037 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:03:59.692152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca46a1e-c48d-45fb-afa2-4537d58f2037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:03:59.692879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca46a1e-c48d-45fb-afa2-4537d58f2037 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=39e5bd1efab744a280b2f054ecdc5883, user.id=54e714ebac5d4f5f8d756c2ec1f73ecc) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:03:59.693185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca46a1e-c48d-45fb-afa2-4537d58f2037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:03:59.694642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca46a1e-c48d-45fb-afa2-4537d58f2037 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:03:59.700423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 577/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:03:59 2022] GET /identity/v3/role_assignments?user.id=54e714ebac5d4f5f8d756c2ec1f73ecc&scope.project.id=39e5bd1efab744a280b2f054ecdc5883&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:04:01.664223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bab27-0477-429f-9998-dc458146e987 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:01.664768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bab27-0477-429f-9998-dc458146e987 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:01.664768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bab27-0477-429f-9998-dc458146e987 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:01.666105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 585/1162] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:01.671981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ffff-530d-49ef-abe9-893de238e2cc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:01.672399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ffff-530d-49ef-abe9-893de238e2cc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:01.672509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ffff-530d-49ef-abe9-893de238e2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:01.678713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:01.693605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8b59ffff-530d-49ef-abe9-893de238e2cc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:01.696960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b59ffff-530d-49ef-abe9-893de238e2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:01.769366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 578/1163] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:02.040874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bab27-0477-429f-9998-dc458146e987 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:02.147948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bab27-0477-429f-9998-dc458146e987 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:02.181632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:02.182261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:02.182547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:02.182820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:02.246581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:02.260994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:02.262490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:02.375621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 586/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:04:02.381558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ffff-530d-49ef-abe9-893de238e2cc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:02.511801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ffff-530d-49ef-abe9-893de238e2cc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:02.548836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:02.554513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45065f-7993-4372-8d26-230b4660f808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:02.555161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45065f-7993-4372-8d26-230b4660f808 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:02.555435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45065f-7993-4372-8d26-230b4660f808 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:02.555703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45065f-7993-4372-8d26-230b4660f808 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:02.563499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45065f-7993-4372-8d26-230b4660f808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:02.565160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45065f-7993-4372-8d26-230b4660f808 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-0c45065f-7993-4372-8d26-230b4660f808 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:02.577953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:02.579270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:04:02.580474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 579/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:04:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:02.585595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:02.684798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:02.699324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fc40f-09a1-4ddd-9447-216391a1494d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:02.735699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9664-1aba-41bc-830b-e1003b4ebbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:02.736425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9664-1aba-41bc-830b-e1003b4ebbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:02.736705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9664-1aba-41bc-830b-e1003b4ebbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:02.736964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9664-1aba-41bc-830b-e1003b4ebbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:02.737607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9664-1aba-41bc-830b-e1003b4ebbb3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:02.737901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9664-1aba-41bc-830b-e1003b4ebbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:02.739363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9664-1aba-41bc-830b-e1003b4ebbb3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:02.747465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 587/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Sep 1 08:04:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:04.676908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b7de8-cf96-4c42-b046-3bd10d044102 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:04.677427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b7de8-cf96-4c42-b046-3bd10d044102 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:04.677427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b7de8-cf96-4c42-b046-3bd10d044102 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:04.678816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 580/1167] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:04.683955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6df6-acfb-4a14-a4be-9a1c62b8c27d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:04.684359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6df6-acfb-4a14-a4be-9a1c62b8c27d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:04.684468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6df6-acfb-4a14-a4be-9a1c62b8c27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:04.703477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-140f6df6-acfb-4a14-a4be-9a1c62b8c27d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:04.704652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-140f6df6-acfb-4a14-a4be-9a1c62b8c27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:04.768992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 588/1168] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:05.039682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b7de8-cf96-4c42-b046-3bd10d044102 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:05.143924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b7de8-cf96-4c42-b046-3bd10d044102 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:05.179087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecde02-8c0e-4fbf-87ca-a5a801bd2e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:05.179690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecde02-8c0e-4fbf-87ca-a5a801bd2e1f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:05.179971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecde02-8c0e-4fbf-87ca-a5a801bd2e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:05.180244 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecde02-8c0e-4fbf-87ca-a5a801bd2e1f None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:05.180925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecde02-8c0e-4fbf-87ca-a5a801bd2e1f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:05.182323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecde02-8c0e-4fbf-87ca-a5a801bd2e1f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:05.199996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 581/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Thu Sep 1 08:04:05 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:07.168002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81a43-1589-47b4-872f-1061ae61d116 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.168526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81a43-1589-47b4-872f-1061ae61d116 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.168526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d81a43-1589-47b4-872f-1061ae61d116 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.170426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 589/1170] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:07.175849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c00e-4213-4736-b1f8-415287b1453c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.176270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c00e-4213-4736-b1f8-415287b1453c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.176396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21c00e-4213-4736-b1f8-415287b1453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.198664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6a21c00e-4213-4736-b1f8-415287b1453c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:07.199868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6a21c00e-4213-4736-b1f8-415287b1453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:07.248221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:07.269660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 582/1171] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:07.544826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81a43-1589-47b4-872f-1061ae61d116 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:07.632680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:07.652215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d81a43-1589-47b4-872f-1061ae61d116 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:07.686639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeccef2-f646-4bd9-a3de-95c428bffc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:07.687290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccef2-f646-4bd9-a3de-95c428bffc38 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.687622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccef2-f646-4bd9-a3de-95c428bffc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.687892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeccef2-f646-4bd9-a3de-95c428bffc38 None admin] PATH_INFO: `/v3/domains/7d79382b144e47e39f9e2124019f586f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.699365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeccef2-f646-4bd9-a3de-95c428bffc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d79382b144e47e39f9e2124019f586f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:07.701064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeccef2-f646-4bd9-a3de-95c428bffc38 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:07.702769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 590/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Sep 1 08:04:07 2022] GET /identity/v3/domains/7d79382b144e47e39f9e2124019f586f => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:07.708877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c00e-4213-4736-b1f8-415287b1453c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:07.808592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21c00e-4213-4736-b1f8-415287b1453c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:07.843532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3907db8e-c11e-4b7f-84e8-c071bec1026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:07.843938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907db8e-c11e-4b7f-84e8-c071bec1026c None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:07.844215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907db8e-c11e-4b7f-84e8-c071bec1026c None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:07.844483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3907db8e-c11e-4b7f-84e8-c071bec1026c None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:07.845146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907db8e-c11e-4b7f-84e8-c071bec1026c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:07.846600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3907db8e-c11e-4b7f-84e8-c071bec1026c None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:07.874567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 583/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:04:07 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:09.870573 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e41248-d734-4487-9361-f02ba06df4d9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:09.871066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e41248-d734-4487-9361-f02ba06df4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:09.871066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e41248-d734-4487-9361-f02ba06df4d9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:09.872389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 591/1174] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:09.877875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7849-6aa3-4d94-843a-aca358697e34 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:09.878326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7849-6aa3-4d94-843a-aca358697e34 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:09.878457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb7849-6aa3-4d94-843a-aca358697e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:09.896277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bdbb7849-6aa3-4d94-843a-aca358697e34 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:09.897483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bdbb7849-6aa3-4d94-843a-aca358697e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:09.924218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:09.964138 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 584/1175] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:10.239474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e41248-d734-4487-9361-f02ba06df4d9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:10.340658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e41248-d734-4487-9361-f02ba06df4d9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:10.373525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793514a-ab2e-4e5d-9478-f57f79e6a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:10.374147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793514a-ab2e-4e5d-9478-f57f79e6a691 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:10.374456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793514a-ab2e-4e5d-9478-f57f79e6a691 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:10.374732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793514a-ab2e-4e5d-9478-f57f79e6a691 None admin] PATH_INFO: `/v3/domains/7d79382b144e47e39f9e2124019f586f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:10.375829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793514a-ab2e-4e5d-9478-f57f79e6a691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7d79382b144e47e39f9e2124019f586f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:10.377260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793514a-ab2e-4e5d-9478-f57f79e6a691 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:10.378855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 592/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Sep 1 08:04:10 2022] GET /identity/v3/domains/7d79382b144e47e39f9e2124019f586f => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:10.384753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb7849-6aa3-4d94-843a-aca358697e34 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:10.484636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb7849-6aa3-4d94-843a-aca358697e34 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:10.517629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a800ef-e7ac-4429-bf4e-8740463d233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:10.518229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a800ef-e7ac-4429-bf4e-8740463d233f None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:10.518527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a800ef-e7ac-4429-bf4e-8740463d233f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:10.518798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a800ef-e7ac-4429-bf4e-8740463d233f None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:10.519438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a800ef-e7ac-4429-bf4e-8740463d233f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:10.520850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a800ef-e7ac-4429-bf4e-8740463d233f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:10.541924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 585/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:04:10 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:04:12.508690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43707b2-98c4-492a-bf8c-8030e41828ca None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:12.509244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43707b2-98c4-492a-bf8c-8030e41828ca None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:12.509244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43707b2-98c4-492a-bf8c-8030e41828ca None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:12.510621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 593/1178] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:12.516478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9d458-8621-4c3e-95d3-496048cbb666 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:12.516887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9d458-8621-4c3e-95d3-496048cbb666 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:12.517032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9d458-8621-4c3e-95d3-496048cbb666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:12.535441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1ee9d458-8621-4c3e-95d3-496048cbb666 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:12.536658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1ee9d458-8621-4c3e-95d3-496048cbb666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:12.550780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:12.606623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 586/1179] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:12.877043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43707b2-98c4-492a-bf8c-8030e41828ca None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:12.889864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:12.977326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43707b2-98c4-492a-bf8c-8030e41828ca None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:13.010180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:13.010959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.011242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.011514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.022074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:13.026823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:13.027884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:04:13.029651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 594/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:13.034670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9d458-8621-4c3e-95d3-496048cbb666 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:13.133192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9d458-8621-4c3e-95d3-496048cbb666 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:13.166614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:13.167225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.167502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.167774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.168441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:13.168741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:13.170878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:13.178938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 587/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:13.185514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:13.255465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:13.291844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4a543-2cb3-4d28-8c79-4a4fccc2a78e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:13.326604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:13.327229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.327508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.327782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] PATH_INFO: `/v3/users/b8ca0b7fe74e4fde9b23085248828af9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.344215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] RBAC: Authorizing `identity:get_user(user_id=b8ca0b7fe74e4fde9b23085248828af9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:13.345675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:13.347349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 595/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:13 2022] GET /identity/v3/users/b8ca0b7fe74e4fde9b23085248828af9 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:13.353465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:13.369599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:13.463537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe47c3-5bbd-4264-a2c8-00969830bcee None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:13.497215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:13.497985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.498282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.498560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.565283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:13.566776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:13.580658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:13.665718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 588/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:04:13.672436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:13.772152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688426d0-2076-4574-ab07-e58c07b39dee None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:13.798143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:13.806159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba65aa1-3f3f-4bc6-8e38-919d47e37bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:13.806809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65aa1-3f3f-4bc6-8e38-919d47e37bdf None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.807086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65aa1-3f3f-4bc6-8e38-919d47e37bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.807357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65aa1-3f3f-4bc6-8e38-919d47e37bdf None admin] PATH_INFO: `/v3/projects/72d67ab5aa6549419312cd9fae72b58c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.808456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba65aa1-3f3f-4bc6-8e38-919d47e37bdf None admin] RBAC: Authorizing `identity:get_project(project_id=72d67ab5aa6549419312cd9fae72b58c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:13.809906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba65aa1-3f3f-4bc6-8e38-919d47e37bdf None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:13.811555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 596/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:13 2022] GET /identity/v3/projects/72d67ab5aa6549419312cd9fae72b58c => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:13.817709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:13.913972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3881bf-97b7-4326-8653-d5ab21961b70 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:13.927236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:13.952949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a7b62-de8e-46c4-9dd3-3413085332ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:13.953542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7b62-de8e-46c4-9dd3-3413085332ef None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:13.953821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7b62-de8e-46c4-9dd3-3413085332ef None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:13.954086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a7b62-de8e-46c4-9dd3-3413085332ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:13.954962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7b62-de8e-46c4-9dd3-3413085332ef None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=72d67ab5aa6549419312cd9fae72b58c, user.id=b8ca0b7fe74e4fde9b23085248828af9) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:13.955272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7b62-de8e-46c4-9dd3-3413085332ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:13.956697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a7b62-de8e-46c4-9dd3-3413085332ef None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:13.962386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 589/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:04:13 2022] GET /identity/v3/role_assignments?user.id=b8ca0b7fe74e4fde9b23085248828af9&scope.project.id=72d67ab5aa6549419312cd9fae72b58c&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:15.887571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bbb38-7d85-45b3-b654-40f44f5f689b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:15.888108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bbb38-7d85-45b3-b654-40f44f5f689b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:15.888230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bbb38-7d85-45b3-b654-40f44f5f689b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:15.889580 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 597/1186] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:15.894841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28c502-19e9-4465-98ea-bf58f15f6f02 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:15.895269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28c502-19e9-4465-98ea-bf58f15f6f02 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:15.895372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28c502-19e9-4465-98ea-bf58f15f6f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:15.913543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3e28c502-19e9-4465-98ea-bf58f15f6f02 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:15.914749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3e28c502-19e9-4465-98ea-bf58f15f6f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:15.979850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 590/1187] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:16.249598 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bbb38-7d85-45b3-b654-40f44f5f689b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:16.348551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5bbb38-7d85-45b3-b654-40f44f5f689b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:16.383250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:16.383874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:16.384153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:16.384426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:16.394534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:16.399468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:16.400661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:04:16.401912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 598/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:16.407375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28c502-19e9-4465-98ea-bf58f15f6f02 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:16.512063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28c502-19e9-4465-98ea-bf58f15f6f02 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:16.519967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:16.547391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:16.548000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:16.548280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:16.548551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:16.549224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:16.549525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:16.550917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:16.559090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 591/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:04:16.566199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:16.624420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:16.668221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e6e73-4555-44ff-ac9c-c711b3152a81 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:16.704310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:16.704928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:16.705204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:16.705472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] PATH_INFO: `/v3/users/b8ca0b7fe74e4fde9b23085248828af9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:16.706763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] RBAC: Authorizing `identity:get_user(user_id=b8ca0b7fe74e4fde9b23085248828af9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:16.708185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:16.709770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 599/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:16 2022] GET /identity/v3/users/b8ca0b7fe74e4fde9b23085248828af9 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:16.715919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:16.815340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d096426-4499-4311-abdb-2f1592924429 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:16.848190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa91409-8b84-4d33-bbf5-882ef6b350bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:16.848815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91409-8b84-4d33-bbf5-882ef6b350bc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:16.849096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91409-8b84-4d33-bbf5-882ef6b350bc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:16.849366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa91409-8b84-4d33-bbf5-882ef6b350bc None admin] PATH_INFO: `/v3/projects/72d67ab5aa6549419312cd9fae72b58c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:16.850496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa91409-8b84-4d33-bbf5-882ef6b350bc None admin] RBAC: Authorizing `identity:get_project(project_id=72d67ab5aa6549419312cd9fae72b58c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:16.851923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa91409-8b84-4d33-bbf5-882ef6b350bc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:16.853545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 592/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:16 2022] GET /identity/v3/projects/72d67ab5aa6549419312cd9fae72b58c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:16.860136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:16.961725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df176d8b-3298-43be-b209-edbb05816139 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:16.985842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:17.001264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c428bd8-4516-4619-99c9-ea97dd33e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:17.001928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428bd8-4516-4619-99c9-ea97dd33e9c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:17.002207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428bd8-4516-4619-99c9-ea97dd33e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:17.002515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c428bd8-4516-4619-99c9-ea97dd33e9c1 None admin] PATH_INFO: `/v3/projects/72d67ab5aa6549419312cd9fae72b58c/users/b8ca0b7fe74e4fde9b23085248828af9/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:17.004429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c428bd8-4516-4619-99c9-ea97dd33e9c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=72d67ab5aa6549419312cd9fae72b58c, user_id=b8ca0b7fe74e4fde9b23085248828af9, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:17.005870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c428bd8-4516-4619-99c9-ea97dd33e9c1 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:17.022727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 600/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:04:16 2022] PUT /identity/v3/projects/72d67ab5aa6549419312cd9fae72b58c/users/b8ca0b7fe74e4fde9b23085248828af9/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:04:18.950025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172f3b-9e0e-4525-9e69-80e10a6e7c9f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:18.950732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172f3b-9e0e-4525-9e69-80e10a6e7c9f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:18.950732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172f3b-9e0e-4525-9e69-80e10a6e7c9f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:18.951858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 593/1193] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:04:18.956941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068aa5f-0083-41c1-a859-954bd4aea58f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:18.957325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068aa5f-0083-41c1-a859-954bd4aea58f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:18.957491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068aa5f-0083-41c1-a859-954bd4aea58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:18.975795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8068aa5f-0083-41c1-a859-954bd4aea58f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:04:18.976982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8068aa5f-0083-41c1-a859-954bd4aea58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:04:19.044669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 601/1194] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:04:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:04:19.315564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172f3b-9e0e-4525-9e69-80e10a6e7c9f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:19.352660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:19.417814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172f3b-9e0e-4525-9e69-80e10a6e7c9f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:19.453999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:19.454657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:19.454934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:19.455201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:19.466480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:04:19.471365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:04:19.472451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:04:19.473695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 594/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:04:19.478701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068aa5f-0083-41c1-a859-954bd4aea58f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:19.577499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068aa5f-0083-41c1-a859-954bd4aea58f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:19.592555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:19.613420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:19.614033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:19.614341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:19.614617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:19.615279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:19.615582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:19.616947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:19.625680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 602/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:19.631684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:19.722888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:19.728907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad165d-78af-4016-a3ee-eaa22fe3c30f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:19.762063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:19.763334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:19.763622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:19.763889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] PATH_INFO: `/v3/users/b8ca0b7fe74e4fde9b23085248828af9` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:19.765001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] RBAC: Authorizing `identity:get_user(user_id=b8ca0b7fe74e4fde9b23085248828af9)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:19.766461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:19.768015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 595/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Sep 1 08:04:19 2022] GET /identity/v3/users/b8ca0b7fe74e4fde9b23085248828af9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:19.773973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:19.882816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d130a-d312-41f7-8810-55448c71dc0d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:19.917159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:19.917762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:19.918041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:19.918339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:19.963509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:19.987179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:19.988636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:20.085140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 603/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:04:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:04:20.091210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:20.189722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6556735-84b6-43f7-af92-2ecf4dc51b5d None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:20.223235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f46e1-7b31-4225-936b-a32a705bf367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:20.223851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f46e1-7b31-4225-936b-a32a705bf367 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:20.224118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f46e1-7b31-4225-936b-a32a705bf367 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:20.224383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f46e1-7b31-4225-936b-a32a705bf367 None admin] PATH_INFO: `/v3/projects/72d67ab5aa6549419312cd9fae72b58c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:20.225481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f46e1-7b31-4225-936b-a32a705bf367 None admin] RBAC: Authorizing `identity:get_project(project_id=72d67ab5aa6549419312cd9fae72b58c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:20.227091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f46e1-7b31-4225-936b-a32a705bf367 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:20.228704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 596/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Sep 1 08:04:20 2022] GET /identity/v3/projects/72d67ab5aa6549419312cd9fae72b58c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:20.236059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:04:20.312680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:20.336161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa66f30-6ef9-41f5-a8df-b3e274919bfd None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:04:20.374077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24441-8554-4721-ad56-d83ce553a9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:04:20.374738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24441-8554-4721-ad56-d83ce553a9df None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:04:20.375019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24441-8554-4721-ad56-d83ce553a9df None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:04:20.375294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24441-8554-4721-ad56-d83ce553a9df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:04:20.376054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24441-8554-4721-ad56-d83ce553a9df None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=72d67ab5aa6549419312cd9fae72b58c, user.id=b8ca0b7fe74e4fde9b23085248828af9) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:04:20.376362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24441-8554-4721-ad56-d83ce553a9df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:04:20.377842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24441-8554-4721-ad56-d83ce553a9df None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:04:20.384590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 604/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:04:20 2022] GET /identity/v3/role_assignments?user.id=b8ca0b7fe74e4fde9b23085248828af9&scope.project.id=72d67ab5aa6549419312cd9fae72b58c&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:04:30.218968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:04:30.381497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=30 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:18.241394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489804a8-7251-4e62-a0a7-8452c04e2678 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:18.242038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489804a8-7251-4e62-a0a7-8452c04e2678 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:18.242038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489804a8-7251-4e62-a0a7-8452c04e2678 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:18.243581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 597/1201] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:18.254126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40327d5-8ac0-433d-a77d-e66716b0dfde None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:18.254684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40327d5-8ac0-433d-a77d-e66716b0dfde None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:18.254684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40327d5-8ac0-433d-a77d-e66716b0dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:18.273812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b40327d5-8ac0-433d-a77d-e66716b0dfde None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:18.275064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b40327d5-8ac0-433d-a77d-e66716b0dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:18.357896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 605/1202] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:05:18.655772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489804a8-7251-4e62-a0a7-8452c04e2678 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:18.783762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489804a8-7251-4e62-a0a7-8452c04e2678 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:18.831212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:18.833127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:18.833127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:18.833127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:18.849521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:18.851281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:18.872645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:18.873941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:18.875212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:18.875212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:18.875212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:18.878480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 598/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:18.880841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40327d5-8ac0-433d-a77d-e66716b0dfde None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:19.020263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40327d5-8ac0-433d-a77d-e66716b0dfde None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:19.054587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:19.063072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caf37e-960e-497e-96c5-5baa2bb8f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:19.063765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf37e-960e-497e-96c5-5baa2bb8f1ea None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:19.064092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf37e-960e-497e-96c5-5baa2bb8f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:19.064401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caf37e-960e-497e-96c5-5baa2bb8f1ea None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:19.065068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caf37e-960e-497e-96c5-5baa2bb8f1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:19.065375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caf37e-960e-497e-96c5-5baa2bb8f1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:19.066858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caf37e-960e-497e-96c5-5baa2bb8f1ea None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:19.086834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 606/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:19.089133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:19.161982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:19.226847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ab119-943d-4f79-b30d-65ad37cc7925 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:19.271165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1e69-5b2f-4558-960d-dcd2bbce4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:19.271844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1e69-5b2f-4558-960d-dcd2bbce4164 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:19.272209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1e69-5b2f-4558-960d-dcd2bbce4164 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:19.272564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1e69-5b2f-4558-960d-dcd2bbce4164 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:19.273322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c1e69-5b2f-4558-960d-dcd2bbce4164 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:19.275403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c1e69-5b2f-4558-960d-dcd2bbce4164 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:19.301057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 599/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Sep 1 08:05:19 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:05:21.421151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b6fb-c024-41a4-bca1-8c7eb09c5e06 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:21.421714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b6fb-c024-41a4-bca1-8c7eb09c5e06 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:21.421888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b6fb-c024-41a4-bca1-8c7eb09c5e06 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:21.423623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 607/1206] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:21.429452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc01d-5c5f-4af6-a92f-09fe1be14ca8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:21.430048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc01d-5c5f-4af6-a92f-09fe1be14ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:21.430048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbc01d-5c5f-4af6-a92f-09fe1be14ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:21.451649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cbdbc01d-5c5f-4af6-a92f-09fe1be14ca8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:21.452934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cbdbc01d-5c5f-4af6-a92f-09fe1be14ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:21.533374 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 600/1207] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:21.840481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768b6fb-c024-41a4-bca1-8c7eb09c5e06 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:21.972572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768b6fb-c024-41a4-bca1-8c7eb09c5e06 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:22.016746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:22.017392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:22.017715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:22.017994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:22.030193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:22.035031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:22.036017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:22.039455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 608/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:22.042177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc01d-5c5f-4af6-a92f-09fe1be14ca8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:22.087374 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:22.157405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbc01d-5c5f-4af6-a92f-09fe1be14ca8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:22.196425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:22.197067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:22.197351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:22.197621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:22.198330 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:22.199224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:22.200902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:22.218926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 601/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:05:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:22.220206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:22.280914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:22.343297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc7eeb-baef-4f77-a999-dfd9970ff8e5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:22.383470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:22.384977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:22.384977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:22.384977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:22.397052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:22.398654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:22.417433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:22.419004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:22.419886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:22.419886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:22.419886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:22.419886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 609/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:22.421449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:22.553286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:22.556841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f42d3-df19-4445-8d28-e9673a69e4e7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:22.614669 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:22.615561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:22.616016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:22.616431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:22.617332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:22.617833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:22.619665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:22.635047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 602/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:22.641237 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:22.757392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6995c5d-386f-4fcf-a260-cc2f674df6e0 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:22.759489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:22.804941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:22.807010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:22.807010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:22.807010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:22.815159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:22.816614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:22.828903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:22.829925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:22.830989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:22.834961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 610/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:22.836284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:22.966117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c9d90-8a20-4a39-b94a-e008dbd51cee None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:23.010005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:23.010762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:23.011855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:23.012257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:23.013246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:23.013588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:23.015202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:23.037398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 603/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:23.043529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:23.174063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11499a27-f7ce-4f46-97f3-16ff59a9bca3 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:23.219202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:23.219916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:23.220268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:23.220608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:23.259885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:23.315582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:23.317257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:23.445126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 611/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:05:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:05:23.451280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:23.491131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:23.597255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378ac68-9b13-4856-8f84-9929ab19a224 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:23.638666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:23.639312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:23.639990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:23.640272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:23.653041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:23.654535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:23.671289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:23.672356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:23.673834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:23.673834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:23.673834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:23.673834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 604/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:23.678413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:23.748898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:23.801844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc06a8-8c24-4e7e-874f-26a06c88c036 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:23.844713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:23.845380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:23.845751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:23.846163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:23.846949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:23.847342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:23.848879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:23.867535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 612/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:23.876241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:23.998226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:24.034656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8dc6-d20f-4419-80a1-62e594e02c3f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:24.079017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:24.079795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:24.080058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:24.080324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:24.087942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:24.090087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:24.102124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:24.103312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:24.104652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:24.109946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:24.110416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 605/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:24.218758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49342a4d-2444-435e-ae35-f72f381c761f None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:24.243116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:24.262489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473fac8-8a0d-4aee-9fa1-baa505fb4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:24.263201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fac8-8a0d-4aee-9fa1-baa505fb4d0c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:24.263574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fac8-8a0d-4aee-9fa1-baa505fb4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:24.263905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473fac8-8a0d-4aee-9fa1-baa505fb4d0c None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:24.264681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fac8-8a0d-4aee-9fa1-baa505fb4d0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:24.265066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fac8-8a0d-4aee-9fa1-baa505fb4d0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:24.266604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473fac8-8a0d-4aee-9fa1-baa505fb4d0c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:24.280052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 613/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:24.286261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:24.427385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a040-2c3f-48d1-ad65-4c2f7ffb5f23 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:24.468818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:24.476269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b66f84-ebd5-4329-9524-fbb2ac3fc7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:24.476953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b66f84-ebd5-4329-9524-fbb2ac3fc7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:24.477226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b66f84-ebd5-4329-9524-fbb2ac3fc7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:24.477535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b66f84-ebd5-4329-9524-fbb2ac3fc7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:24.478741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b66f84-ebd5-4329-9524-fbb2ac3fc7f4 None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=6b056c355c8b4959b5808cc22304e36d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:24.478980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b66f84-ebd5-4329-9524-fbb2ac3fc7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:24.480531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b66f84-ebd5-4329-9524-fbb2ac3fc7f4 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:24.489134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 606/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:05:24 2022] GET /identity/v3/role_assignments?user.id=6b056c355c8b4959b5808cc22304e36d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:26.480748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f11-719d-4360-b1ec-828a35060fad None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:26.481314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f11-719d-4360-b1ec-828a35060fad None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:26.481314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38556f11-719d-4360-b1ec-828a35060fad None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:26.482683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 614/1220] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:26.488336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9e4a7-545d-4d56-9400-a99448a72fb2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:26.488738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9e4a7-545d-4d56-9400-a99448a72fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:26.489010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9e4a7-545d-4d56-9400-a99448a72fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:26.507934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-70c9e4a7-545d-4d56-9400-a99448a72fb2 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:26.509143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-70c9e4a7-545d-4d56-9400-a99448a72fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:26.584737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 607/1221] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:05:26.854178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556f11-719d-4360-b1ec-828a35060fad None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:26.962757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38556f11-719d-4360-b1ec-828a35060fad None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:27.000747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:27.001471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:27.001780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:27.002084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:27.014370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:27.019670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:27.020597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:27.021406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 615/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:05:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:27.027398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9e4a7-545d-4d56-9400-a99448a72fb2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:27.139729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9e4a7-545d-4d56-9400-a99448a72fb2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:27.168455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:27.180439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:27.180979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:27.181317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:27.181591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:27.182293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] RBAC: Adding query filter params (name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:27.182601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:27.184237 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:27.193881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 608/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:05:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:27.201184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:27.252203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:27.321521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250cca0-5d27-4d9a-9877-e73d5c8668f1 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:27.366340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:27.366983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:27.367265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:27.367546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:27.379038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:27.380500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:27.399596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:27.400927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:27.403266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:27.403266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:27.403266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:27.403266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 616/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:27.407569 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:27.534961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d99b1-346b-4103-a686-d096d96f6dea None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:27.574434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:27.575074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:27.575362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:27.575636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:27.576417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:27.576592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:27.578103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:27.602841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 609/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:27.604467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:27.729058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:27.741479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab2d41-f8fe-4149-a505-7763192b5e4a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:27.808418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:27.809839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:27.810464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:27.810864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:27.822702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:27.825078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:27.838050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:27.839959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:27.841166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 617/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:27.849967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:27.923924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:28.000215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbee53-40c1-4095-b57e-c50a02b27ece None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:28.044941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:28.045670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:28.046037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:28.046419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:28.047211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:28.047481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:28.049212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:28.071215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 610/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:28.079343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:28.225148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327997c4-16e2-42dc-82d3-9b8861a3fb5a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:28.272375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:28.273448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:28.273923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:28.274453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:28.288801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:28.290404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:28.310750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:28.313084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:28.315171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:28.315171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:28.315171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:28.315171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 618/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:28.319882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:28.470904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e6f85-5b0a-4fac-926d-96d182fee888 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:28.473852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:28.518723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:28.519734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:28.520303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:28.520854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:28.522017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:28.522742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:28.525465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:28.543032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 611/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:28.549557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:28.562005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:28.688462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdb149-97c9-48f3-81c0-987d94092a3d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:28.726882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:28.727537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:28.727816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:28.728087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:28.736558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:28.738090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:28.754081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:28.756210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:28.757194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 619/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:28.762784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:28.892279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250405d-201b-4d16-b89e-d133b85a6531 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:28.931148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd2682-22a6-4153-a591-a863959b1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:28.931740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd2682-22a6-4153-a591-a863959b1972 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:28.932024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd2682-22a6-4153-a591-a863959b1972 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:28.932281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd2682-22a6-4153-a591-a863959b1972 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:28.933197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd2682-22a6-4153-a591-a863959b1972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:28.933556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd2682-22a6-4153-a591-a863959b1972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:28.934943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd2682-22a6-4153-a591-a863959b1972 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:28.954516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 612/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:28.955794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:29.038517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:29.080930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110e334-bc85-40e4-95f4-e1f4eb365de4 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:29.133333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c0540-eaa8-4087-ae06-7fd7c0196e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:29.134034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0540-eaa8-4087-ae06-7fd7c0196e2e None admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:29.134412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0540-eaa8-4087-ae06-7fd7c0196e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:29.134616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c0540-eaa8-4087-ae06-7fd7c0196e2e None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/6b056c355c8b4959b5808cc22304e36d/roles/cb1108a3a43e41cb83124569db481d4a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:29.157340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c0540-eaa8-4087-ae06-7fd7c0196e2e None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=6b056c355c8b4959b5808cc22304e36d, role_id=cb1108a3a43e41cb83124569db481d4a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:29.158770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c0540-eaa8-4087-ae06-7fd7c0196e2e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:29.177471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 620/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:05:28 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/6b056c355c8b4959b5808cc22304e36d/roles/cb1108a3a43e41cb83124569db481d4a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:05:31.588968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299b3a5-76e6-4a20-bf92-e76b0311c402 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:31.589531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299b3a5-76e6-4a20-bf92-e76b0311c402 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:31.589838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3299b3a5-76e6-4a20-bf92-e76b0311c402 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:31.592689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 613/1233] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:31.599969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cf37-250c-46fb-83c6-26e8e5e90c87 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:31.600629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cf37-250c-46fb-83c6-26e8e5e90c87 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:31.600629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cf37-250c-46fb-83c6-26e8e5e90c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:31.623408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7cc8cf37-250c-46fb-83c6-26e8e5e90c87 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:31.625104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7cc8cf37-250c-46fb-83c6-26e8e5e90c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:31.723519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 621/1234] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:32.015411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299b3a5-76e6-4a20-bf92-e76b0311c402 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:32.044622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:32.169999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3299b3a5-76e6-4a20-bf92-e76b0311c402 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:32.222761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:32.223579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:32.223903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:32.224179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:32.240296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:32.248437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:32.249667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:32.250654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 614/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Sep 1 08:05:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:32.257296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cf37-250c-46fb-83c6-26e8e5e90c87 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:32.345495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:32.423898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cf37-250c-46fb-83c6-26e8e5e90c87 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:32.480553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:32.481216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:32.481531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:32.481893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:32.482697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] RBAC: Adding query filter params (name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:32.483050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:32.484690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:32.496410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 622/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Sep 1 08:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:32.504270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:32.669293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:32.700059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bb916-c436-4e8a-a57f-fe6c56e8650a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:32.767291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:32.767939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:32.768217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:32.768482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:32.781564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:32.783387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:32.802795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:32.803898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:32.805028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:32.805028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:32.805028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:32.805028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 615/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:32.811362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:32.974147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb4cac-52c2-458c-b4b1-bf687c4acb83 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:32.986544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:33.018977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:33.019588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:33.019927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:33.020220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:33.020921 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:33.021245 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:33.022862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:33.038440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 623/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:33.045653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:33.206464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f6f1-0803-495a-9a34-ac9b0865c709 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:33.257290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:33.258002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:33.258474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:33.258810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:33.270375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:33.271804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:33.273417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:33.289015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:33.290406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:33.291570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 616/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:33.300690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:33.438439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479e7cc-0a96-45ce-96af-03cfcab23b5c None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:33.509221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:33.510013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:33.510527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:33.512438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:33.514869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:33.515681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:33.519724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:33.558290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 624/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:33.567238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:33.733791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b000d-35df-47e9-988c-cad660203b78 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:33.778534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:33.779159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:33.779438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:33.779710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:33.871893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:33.880105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:33.881595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:34.016174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 617/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:05:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:05:34.022474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:34.056463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:34.177432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194ff4-f617-48d9-98e1-0017df3e95ee None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:34.219526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:34.220172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:34.220528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:34.220703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:34.237779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:34.239564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:34.259051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:34.260111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:34.262020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:34.262020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:34.262020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:34.262020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 625/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:34.271376 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:34.435592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:34.446529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d504a4-f4b7-4668-95fa-243a7418b158 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:34.500324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:34.501034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:34.501314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:34.501790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:34.502682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:34.502975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:34.504421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:34.527672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 618/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:34.534076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:34.652740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:34.685989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea20bc2-5f8b-4689-b680-780a13e94f9e None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:34.729365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:34.730687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:34.730978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:34.731255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:34.740457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:34.743009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:34.759112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:34.760197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:34.762781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 626/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:34.769075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:34.915798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176183dc-4c2c-4877-85b5-0412a3ec4deb None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:34.959854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df170e8-03d8-4dbe-b56f-93bd3ebc34af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:34.960555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df170e8-03d8-4dbe-b56f-93bd3ebc34af None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:34.960835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df170e8-03d8-4dbe-b56f-93bd3ebc34af None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:34.961165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df170e8-03d8-4dbe-b56f-93bd3ebc34af None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:34.961998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df170e8-03d8-4dbe-b56f-93bd3ebc34af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:34.962440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df170e8-03d8-4dbe-b56f-93bd3ebc34af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:34.964142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df170e8-03d8-4dbe-b56f-93bd3ebc34af None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:34.980076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 619/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:34.989077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:35.163016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d51972-441e-47cc-a4f6-7d1ff98a0d49 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:35.225138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d37abb-2da8-4e97-ab45-1df8f61caacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:35.225752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37abb-2da8-4e97-ab45-1df8f61caacc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:35.226187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37abb-2da8-4e97-ab45-1df8f61caacc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:35.226772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37abb-2da8-4e97-ab45-1df8f61caacc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:35.227784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d37abb-2da8-4e97-ab45-1df8f61caacc None admin] RBAC: Adding query filter params (role.id=cb1108a3a43e41cb83124569db481d4a, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=6b056c355c8b4959b5808cc22304e36d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:35.228431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d37abb-2da8-4e97-ab45-1df8f61caacc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:35.231061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d37abb-2da8-4e97-ab45-1df8f61caacc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:35.239109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 627/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:05:34 2022] GET /identity/v3/role_assignments?user.id=6b056c355c8b4959b5808cc22304e36d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=cb1108a3a43e41cb83124569db481d4a => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:37.676984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e3da-1d4b-4ca5-b590-d05f0c4971e9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:37.677870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e3da-1d4b-4ca5-b590-d05f0c4971e9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:37.678009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691e3da-1d4b-4ca5-b590-d05f0c4971e9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:37.680145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 620/1247] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:37.687786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d44956-4da8-4750-95f6-eb77ac351792 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:37.688722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d44956-4da8-4750-95f6-eb77ac351792 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:37.688722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d44956-4da8-4750-95f6-eb77ac351792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:37.696964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:37.710914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-01d44956-4da8-4750-95f6-eb77ac351792 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:37.712139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-01d44956-4da8-4750-95f6-eb77ac351792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:37.800521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 628/1248] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:38.126549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691e3da-1d4b-4ca5-b590-d05f0c4971e9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:38.147973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:38.287444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691e3da-1d4b-4ca5-b590-d05f0c4971e9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:38.331907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:38.332617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:38.332891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:38.333183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:38.351958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:38.362115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:38.363715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:38.364771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 621/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 08:05:38.371146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d44956-4da8-4750-95f6-eb77ac351792 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:38.522502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d44956-4da8-4750-95f6-eb77ac351792 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:38.569283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:38.578225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:38.578955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:38.579348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:38.579675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:38.580468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:38.580776 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:38.582370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:38.594635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 629/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:38.602734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:38.723518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:38.758354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96992b-db36-4e35-82de-a9517d8f09f6 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:38.804156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:38.804884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:38.805280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:38.805655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:38.820872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:38.822456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:38.845817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:38.847248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:38.848357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:38.848357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:38.848357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:38.848357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 622/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:38.855643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.017093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b224c6-f69a-4df4-aa78-54655fbe246a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.077122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.077658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.077927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.078197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.078891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:39.079188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.080583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:39.094887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 630/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:39.103590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.266413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9396ef4-e31e-478a-8894-78bfca43c59a None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.313445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:39.324043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.324787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.325069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.325384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.334884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.336522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:39.351042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:39.352531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:39.354790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 623/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:39.359713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.434169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:39.509674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba734a-d63e-4eee-a9e8-b94a8ffa92cc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.556592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.557509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.558033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.558504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.559578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:39.560086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.562090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:39.590793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 631/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:39.595869 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:39.727712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913d567-2c3e-4736-b4a3-59e5aef79477 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:39.778159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:39.778873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:39.779295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:39.779660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:39.853928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:39.874367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:39.876455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.017882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 624/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:05:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:05:40.025553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:40.170599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823aa942-cd4f-4ea2-a4b9-3c92e826a8bc None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:40.189267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:40.215672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:40.216326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:40.216647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:40.216904 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:40.237810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:40.240787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:40.269510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:40.271120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:40.272880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:40.272880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:40.272880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:40.272880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 632/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:40.281162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:40.425302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:40.448872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6d233-4202-4b42-999b-eaa831f08305 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:40.502989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:40.503686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:40.503969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:40.504248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:40.504923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:40.505240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:40.506738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.522368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 625/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:40.532552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:40.689253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ab200-1445-4046-9104-debb7ddda76b None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:40.740693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:40.741846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:40.742670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:40.743049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:40.754639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:40.756608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:40.774695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:40.775774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:40.777338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:40.782297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 633/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:40.783750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:40.937326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c283d1-71b2-4ceb-9fc2-997b269b6709 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:40.977721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f5615-c537-4fcd-8d17-943f64216f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:40.978562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f5615-c537-4fcd-8d17-943f64216f00 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:40.978839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f5615-c537-4fcd-8d17-943f64216f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:40.979137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f5615-c537-4fcd-8d17-943f64216f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:40.980061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f5615-c537-4fcd-8d17-943f64216f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:40.980061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f5615-c537-4fcd-8d17-943f64216f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:40.981637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f5615-c537-4fcd-8d17-943f64216f00 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:40.995773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 626/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:41.002747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:41.037080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:41.159578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4cdce-dd91-4ffe-b062-0a8468fd5f91 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:41.204679 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61bd19-93d4-4f6b-9429-78dc5c85d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:41.205512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61bd19-93d4-4f6b-9429-78dc5c85d570 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:41.205765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61bd19-93d4-4f6b-9429-78dc5c85d570 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:41.206138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61bd19-93d4-4f6b-9429-78dc5c85d570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:41.207039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61bd19-93d4-4f6b-9429-78dc5c85d570 None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=6b056c355c8b4959b5808cc22304e36d) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:41.207525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61bd19-93d4-4f6b-9429-78dc5c85d570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:41.210309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61bd19-93d4-4f6b-9429-78dc5c85d570 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:41.218827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 634/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:05:41 2022] GET /identity/v3/role_assignments?user.id=6b056c355c8b4959b5808cc22304e36d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:43.377021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e2ff9-ac80-45f5-95fe-e724a145a5e6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:43.377559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e2ff9-ac80-45f5-95fe-e724a145a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:43.377559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e2ff9-ac80-45f5-95fe-e724a145a5e6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:43.379003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 627/1261] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:43.384840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12485b3-5756-4114-aef1-100ff10c5ed4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:43.385519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12485b3-5756-4114-aef1-100ff10c5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:43.386384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12485b3-5756-4114-aef1-100ff10c5ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:43.405897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b12485b3-5756-4114-aef1-100ff10c5ed4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:43.407156 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b12485b3-5756-4114-aef1-100ff10c5ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:43.487465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 635/1262] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:43.761884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e2ff9-ac80-45f5-95fe-e724a145a5e6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:43.775647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:43.892595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e2ff9-ac80-45f5-95fe-e724a145a5e6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:43.932257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:43.933002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:43.933313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:43.933622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:43.945105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:43.950178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:43.951332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:43.952475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 628/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:43.958094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12485b3-5756-4114-aef1-100ff10c5ed4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:43.978315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.064657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12485b3-5756-4114-aef1-100ff10c5ed4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.102057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.102687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.103228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.103498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.104837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:44.105141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.106526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.116174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 636/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:44.125388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.204608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.240055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca9d30-307f-47bb-8283-d64e828c01d1 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.276068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.276865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.277182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.277455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.288165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.289616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:44.304645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:44.305817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:44.307062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:44.307062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:44.307062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:44.307062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 629/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:44.312294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.398784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.419583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bcbda-b79f-4a3b-9c87-7d37885b67f2 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.459724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.460634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.461101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.461585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.462541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:44.462880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.465078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.480567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 637/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:44.486638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.599442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab42db-deb6-46ab-8b65-c54d2ed830f9 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.622214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.641619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.643737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.644250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.644644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] PATH_INFO: `/v3/users/placement` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.655803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.657301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:44.669064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:44.670282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:44.671295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 630/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:44.676240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.808927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9940ec7-fd1e-49d2-8c95-6c72749b3508 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:44.845584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:44.846182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:44.846182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:44.846182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:44.847729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:44.847729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:44.849181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:44.859335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:44.870126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 638/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:44.876026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:44.984781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81f037-b61a-4fe7-868a-734131d190df None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.019042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.019620 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.019903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.020185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.031911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.033368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:45.048502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:45.049943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:45.051511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:45.051511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:45.051511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:45.051511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 631/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:45.056163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.165397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a29aa8-4c60-44a6-b27f-05c438696d48 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.206028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.206664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.206944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.207214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.207857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:45.208159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.209533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.222475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 639/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:45.228800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.262000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:45.333686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a704b-cde2-4633-a760-9e2478e0952b None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.381247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.381879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.382151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.382449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.390168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.391758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:45.403960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:45.405085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:45.406404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 632/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:45.411329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.483553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:45.533060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb5e65-6048-4033-8b46-a6ef40daf933 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.571030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7b60b-ea2e-48a6-8e7a-c333353102a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.571638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b60b-ea2e-48a6-8e7a-c333353102a6 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.571911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b60b-ea2e-48a6-8e7a-c333353102a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.572179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7b60b-ea2e-48a6-8e7a-c333353102a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.572925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7b60b-ea2e-48a6-8e7a-c333353102a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:45.573229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7b60b-ea2e-48a6-8e7a-c333353102a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.575452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7b60b-ea2e-48a6-8e7a-c333353102a6 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.588860 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 640/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:45.595127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:45.696698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:45.706983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f0dee-5017-477e-b851-7e31dd420fba None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:45.743635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b0203-0f8d-41f8-8330-312a419c2530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:45.744304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b0203-0f8d-41f8-8330-312a419c2530 None admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:45.745150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b0203-0f8d-41f8-8330-312a419c2530 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:45.745605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b0203-0f8d-41f8-8330-312a419c2530 None admin] PATH_INFO: `/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/6b056c355c8b4959b5808cc22304e36d/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:45.747748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b0203-0f8d-41f8-8330-312a419c2530 None admin] RBAC: Authorizing `identity:create_grant(project_id=b77ce5545b134888bb724ed6f37a6a12, user_id=6b056c355c8b4959b5808cc22304e36d, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:45.749194 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b0203-0f8d-41f8-8330-312a419c2530 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:45.764674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 633/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Sep 1 08:05:45 2022] PUT /identity/v3/projects/b77ce5545b134888bb724ed6f37a6a12/users/6b056c355c8b4959b5808cc22304e36d/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:05:47.791141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d02ac4-565d-4a35-9a9b-50d1690615bb None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:47.791813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d02ac4-565d-4a35-9a9b-50d1690615bb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:47.791813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d02ac4-565d-4a35-9a9b-50d1690615bb None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:47.793826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 641/1274] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:47.801382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc9fde-93a0-48f5-a77e-6568b982473c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:47.801952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc9fde-93a0-48f5-a77e-6568b982473c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:47.802084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc9fde-93a0-48f5-a77e-6568b982473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:47.821983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-48cc9fde-93a0-48f5-a77e-6568b982473c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:47.823333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-48cc9fde-93a0-48f5-a77e-6568b982473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:47.892711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 634/1275] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:48.175881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d02ac4-565d-4a35-9a9b-50d1690615bb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:48.296671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d02ac4-565d-4a35-9a9b-50d1690615bb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:48.314585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:48.332229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:48.332855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.333132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.333400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.343599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 08:05:48.348479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:48.349738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:48.350720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 642/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:48.358815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc9fde-93a0-48f5-a77e-6568b982473c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:48.447676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:48.475463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc9fde-93a0-48f5-a77e-6568b982473c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:48.521576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:48.522219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.522524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.522832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.523513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:48.523824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:48.525196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:48.534345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 635/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:48.540490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:48.657130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8503930-998f-4867-9285-bd32992f0518 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:48.691488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:48.692105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.692378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.692640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.706469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:48.707883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:48.723298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:48.724613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:48.725567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:48.725567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:48.725567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:48.725567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 643/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:48.734480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:48.844325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e08c-2941-4e55-aa9c-f360d083e348 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:48.882070 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:48.882707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:48.882989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:48.883263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:48.883919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:48.884221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:48.886224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:48.898372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 636/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:48.905323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:48.941392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.023291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d3831-2000-45de-84ce-8461c320491d None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.060739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.061359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.061629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.061895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.070199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.071665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 08:05:49.083939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:49.085136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:49.086258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 644/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:49.092888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.098726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.215634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543570-3e74-4cd1-bbaa-779d85399c4f None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.263116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.264080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.264518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.264872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.265770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:49.266077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.267794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.287098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 637/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:49.294898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.397715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.409883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cffe6-9f25-4f3a-a2e4-22fbcb42c20a None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.453260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.454078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.454484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.455082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.530950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.532488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.637398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.648497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 645/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 08:05:49.655161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.733165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:49.782412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78d564-c3ff-4b83-bb99-206414149de7 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:49.821521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:49.822162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:49.822559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:49.822916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:49.833690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:49.835196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 08:05:49.850484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:49.852198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 08:05:49.853628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 08:05:49.853628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 08:05:49.853628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:49.853628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 638/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:49.858834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:49.980045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63bb03-5871-4e09-ad5f-249bd748b593 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.019192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.019803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.020084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.020357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.021086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:50.021385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.022812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.035896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 646/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Sep 1 08:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:50.044433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:50.165623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89fe1d3-c87f-4d24-9341-9871de6e7f01 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.181276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:50.213606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.214233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.214543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.214898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.222215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.223744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 08:05:50.235804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:50.236930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: ERROR keystone.server.flask.application Sep 01 08:05:50.238182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 639/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:50.243087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:50.305363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:50.365156 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6554d-e54e-462f-b549-d45c5d69e961 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.402829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233c81b-ae6e-495e-a954-e401d2bd559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.403438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233c81b-ae6e-495e-a954-e401d2bd559b None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.403717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233c81b-ae6e-495e-a954-e401d2bd559b None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.403993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233c81b-ae6e-495e-a954-e401d2bd559b None admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.404693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233c81b-ae6e-495e-a954-e401d2bd559b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:50.404993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233c81b-ae6e-495e-a954-e401d2bd559b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.406465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233c81b-ae6e-495e-a954-e401d2bd559b None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.419647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 647/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:50.426300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:50.548500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef014800-3451-4b40-bd94-9b940d812866 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:50.590641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca3384-c89f-48e4-b0be-9f2009f4e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:50.591250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3384-c89f-48e4-b0be-9f2009f4e9dc None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:50.591563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3384-c89f-48e4-b0be-9f2009f4e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:50.591927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca3384-c89f-48e4-b0be-9f2009f4e9dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:50.592831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3384-c89f-48e4-b0be-9f2009f4e9dc None admin] RBAC: Adding query filter params (role.id=50ec6d9e36dd45108a0bbacd15fed336, scope.project.id=b77ce5545b134888bb724ed6f37a6a12, user.id=6b056c355c8b4959b5808cc22304e36d) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:50.593229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3384-c89f-48e4-b0be-9f2009f4e9dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:50.595158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca3384-c89f-48e4-b0be-9f2009f4e9dc None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:50.603027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 640/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Sep 1 08:05:50 2022] GET /identity/v3/role_assignments?user.id=6b056c355c8b4959b5808cc22304e36d&scope.project.id=b77ce5545b134888bb724ed6f37a6a12&role.id=50ec6d9e36dd45108a0bbacd15fed336 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:52.668433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced749d-7fb0-4fa7-851b-8b862627bca3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:52.669167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced749d-7fb0-4fa7-851b-8b862627bca3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:52.669167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced749d-7fb0-4fa7-851b-8b862627bca3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:52.670336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 648/1288] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:05:52.676118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051bcc1-6449-4619-bc02-832b3515a967 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:52.676579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051bcc1-6449-4619-bc02-832b3515a967 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:52.676685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051bcc1-6449-4619-bc02-832b3515a967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:52.695912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0051bcc1-6449-4619-bc02-832b3515a967 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:52.697132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0051bcc1-6449-4619-bc02-832b3515a967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:52.732377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:52.781371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 641/1289] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:53.067736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced749d-7fb0-4fa7-851b-8b862627bca3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:53.177897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced749d-7fb0-4fa7-851b-8b862627bca3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:53.191809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:53.219335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:53.219977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:53.220255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:53.220527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:53.221118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:53.222514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:53.232394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:53.233657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:53.234696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 649/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:05:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:53.239937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051bcc1-6449-4619-bc02-832b3515a967 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:53.356529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0051bcc1-6449-4619-bc02-832b3515a967 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:53.392907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df12b9-72c7-47c9-a9b7-cc05fe3af342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:53.393507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df12b9-72c7-47c9-a9b7-cc05fe3af342 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:53.393775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df12b9-72c7-47c9-a9b7-cc05fe3af342 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:53.394047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df12b9-72c7-47c9-a9b7-cc05fe3af342 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:53.394721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df12b9-72c7-47c9-a9b7-cc05fe3af342 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:53.395021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df12b9-72c7-47c9-a9b7-cc05fe3af342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:53.396380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df12b9-72c7-47c9-a9b7-cc05fe3af342 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:53.401711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 642/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Sep 1 08:05:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:53.408125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:53.542810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30aa72-c025-452c-a8f2-7a00fd24aa71 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:53.582229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b5335-66eb-45c2-bdd5-69c2fe03c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:53.582912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5335-66eb-45c2-bdd5-69c2fe03c79c None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:53.583191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5335-66eb-45c2-bdd5-69c2fe03c79c None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:53.583568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5335-66eb-45c2-bdd5-69c2fe03c79c None admin] PATH_INFO: `/v3/services` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:53.584242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5335-66eb-45c2-bdd5-69c2fe03c79c None admin] RBAC: Adding query filter params (type=placement) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:53.584661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5335-66eb-45c2-bdd5-69c2fe03c79c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:53.586030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b5335-66eb-45c2-bdd5-69c2fe03c79c None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:53.598427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 650/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Sep 1 08:05:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:55.646721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69555c11-6d92-4825-b465-77cdc5c10128 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:55.647280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69555c11-6d92-4825-b465-77cdc5c10128 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:55.647280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69555c11-6d92-4825-b465-77cdc5c10128 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:55.648603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 643/1293] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:05:55.654931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763be31-1c1c-4752-a562-4ca1b3ec27aa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:55.655477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763be31-1c1c-4752-a562-4ca1b3ec27aa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:55.655477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763be31-1c1c-4752-a562-4ca1b3ec27aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:55.675744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b763be31-1c1c-4752-a562-4ca1b3ec27aa None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:55.677359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b763be31-1c1c-4752-a562-4ca1b3ec27aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:55.712594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:55.759521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 651/1294] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:05:56.040420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69555c11-6d92-4825-b465-77cdc5c10128 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:56.080286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:56.164679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69555c11-6d92-4825-b465-77cdc5c10128 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:56.203319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953cd8f-96df-4842-8cd5-dfad4bbc4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:56.203939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cd8f-96df-4842-8cd5-dfad4bbc4701 None admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:56.204227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cd8f-96df-4842-8cd5-dfad4bbc4701 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:56.204502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953cd8f-96df-4842-8cd5-dfad4bbc4701 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:56.205240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cd8f-96df-4842-8cd5-dfad4bbc4701 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:56.206820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953cd8f-96df-4842-8cd5-dfad4bbc4701 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:56.222044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 644/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Sep 1 08:05:56 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:05:58.212588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f0f4e-4345-4311-89dd-157b54ea5cf9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.213645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f0f4e-4345-4311-89dd-157b54ea5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.213645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f0f4e-4345-4311-89dd-157b54ea5cf9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.215024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 652/1296] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:05:58.220105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8e21-10d2-41b9-9d93-02954d84eac4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.220524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8e21-10d2-41b9-9d93-02954d84eac4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.220645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8e21-10d2-41b9-9d93-02954d84eac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.239393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d79f8e21-10d2-41b9-9d93-02954d84eac4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:05:58.240577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d79f8e21-10d2-41b9-9d93-02954d84eac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:05:58.312153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 645/1297] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:05:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 08:05:58.609919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f0f4e-4345-4311-89dd-157b54ea5cf9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:58.715258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f0f4e-4345-4311-89dd-157b54ea5cf9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:58.750215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:58.750876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.751159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.751431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.752016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:58.753538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:05:58.764129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:05:58.765790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:05:58.766949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 653/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:05:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:05:58.771506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f8e21-10d2-41b9-9d93-02954d84eac4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:58.791993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:58.879432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f8e21-10d2-41b9-9d93-02954d84eac4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:58.914939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298b85-243c-4212-8642-569f409e0456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:58.915548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298b85-243c-4212-8642-569f409e0456 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:58.915831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298b85-243c-4212-8642-569f409e0456 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:58.916248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298b85-243c-4212-8642-569f409e0456 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:58.917062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298b85-243c-4212-8642-569f409e0456 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:58.917369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298b85-243c-4212-8642-569f409e0456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:58.918778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298b85-243c-4212-8642-569f409e0456 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:58.923919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 646/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Sep 1 08:05:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:05:58.929891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:58.964046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:59.034996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cebbe5-974b-4db7-90e8-b0198b127114 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.069132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954614e7-a830-4048-81ea-ab03d61e186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.069734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954614e7-a830-4048-81ea-ab03d61e186a None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.070012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954614e7-a830-4048-81ea-ab03d61e186a None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.070309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954614e7-a830-4048-81ea-ab03d61e186a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.071015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954614e7-a830-4048-81ea-ab03d61e186a None admin] RBAC: Adding query filter params (interface=public, service_id=8eb21906eb884f0ebb0fa280f57a1425, region_id=RegionOne) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:05:59.071320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954614e7-a830-4048-81ea-ab03d61e186a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.073310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954614e7-a830-4048-81ea-ab03d61e186a None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.078726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 654/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Sep 1 08:05:58 2022] GET /identity/v3/endpoints?service_id=8eb21906eb884f0ebb0fa280f57a1425&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:05:59.084886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298b85-243c-4212-8642-569f409e0456 None admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:05:59.164436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:05:59.184036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298b85-243c-4212-8642-569f409e0456 None admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:05:59.222976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51835e-2c64-44e3-b21f-eda59a335407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:05:59.223665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51835e-2c64-44e3-b21f-eda59a335407 None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:05:59.223844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51835e-2c64-44e3-b21f-eda59a335407 None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:05:59.224112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51835e-2c64-44e3-b21f-eda59a335407 None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:05:59.224712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51835e-2c64-44e3-b21f-eda59a335407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:05:59.226077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51835e-2c64-44e3-b21f-eda59a335407 None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:05:59.233254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 647/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Sep 1 08:05:59 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:06:01.170099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d0907-bd84-42cc-8f48-5992c0487d34 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:01.170684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d0907-bd84-42cc-8f48-5992c0487d34 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:01.170684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d0907-bd84-42cc-8f48-5992c0487d34 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:01.172005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 655/1302] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:06:01.177061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ce96-07f8-4468-9c05-9e885ef1d662 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:01.177447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ce96-07f8-4468-9c05-9e885ef1d662 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:01.177599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef2ce96-07f8-4468-9c05-9e885ef1d662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:01.195390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bef2ce96-07f8-4468-9c05-9e885ef1d662 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:06:01.196570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bef2ce96-07f8-4468-9c05-9e885ef1d662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:06:01.265672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 648/1303] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:06:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 08:06:01.541391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d0907-bd84-42cc-8f48-5992c0487d34 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:01.636316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:01.643100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d0907-bd84-42cc-8f48-5992c0487d34 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:01.675953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:01.676570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:01.676844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:01.677113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:01.677684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:01.679061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 08:06:01.688262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 08:06:01.689457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application with Lock( Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self._enter() Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application return self.creator() Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application created_value = creator( Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: ERROR keystone.server.flask.application Sep 01 08:06:01.690693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 656/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Sep 1 08:06:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 08:06:01.695424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2ce96-07f8-4468-9c05-9e885ef1d662 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:01.776724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:01.801644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef2ce96-07f8-4468-9c05-9e885ef1d662 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:01.835965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f407d8-aa72-4dbb-978a-1e09da42995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:01.836573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f407d8-aa72-4dbb-978a-1e09da42995d None admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:01.836854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f407d8-aa72-4dbb-978a-1e09da42995d None admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:01.837126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f407d8-aa72-4dbb-978a-1e09da42995d None admin] PATH_INFO: `/v3/services` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:01.838345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f407d8-aa72-4dbb-978a-1e09da42995d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:06:01.838633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f407d8-aa72-4dbb-978a-1e09da42995d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:01.840005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f407d8-aa72-4dbb-978a-1e09da42995d None admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:01.845217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 649/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Sep 1 08:06:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:06:01.851172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:06:01.953551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb4bd-c080-4146-a511-7d926bbfc9a5 None admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:06:01.988092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c3b07-d2f1-49a9-8335-a775f7f07db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:06:01.988691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3b07-d2f1-49a9-8335-a775f7f07db7 None admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:06:01.988967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3b07-d2f1-49a9-8335-a775f7f07db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:06:01.989233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3b07-d2f1-49a9-8335-a775f7f07db7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:06:01.989883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c3b07-d2f1-49a9-8335-a775f7f07db7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:06:01.991265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c3b07-d2f1-49a9-8335-a775f7f07db7 None admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:06:02.011033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 657/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:06:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:06:11.842096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=30 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:06:12.005980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:09.025777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a93db-7090-49ce-a643-5ecc882587f6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:09.026925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a93db-7090-49ce-a643-5ecc882587f6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:09.027450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a93db-7090-49ce-a643-5ecc882587f6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:09.034824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e36c-300b-479d-a091-dbad9a470945 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:09.035777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e36c-300b-479d-a091-dbad9a470945 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:09.036279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653e36c-300b-479d-a091-dbad9a470945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:09.041969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 650/1307] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:09.128766 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c653e36c-300b-479d-a091-dbad9a470945 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:09.130512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c653e36c-300b-479d-a091-dbad9a470945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:09.334413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 658/1308] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:09.668146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68963e5-d735-4a0c-99d4-55cfea7c1a1f None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:09.668742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68963e5-d735-4a0c-99d4-55cfea7c1a1f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:09.669632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68963e5-d735-4a0c-99d4-55cfea7c1a1f None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:09.672597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 651/1309] 10.222.0.36 () {54 vars in 965 bytes} [Thu Sep 1 08:07:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:09.679730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837794-67d0-436c-b630-e0ba34608715 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:09.680033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837794-67d0-436c-b630-e0ba34608715 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:09.680317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e837794-67d0-436c-b630-e0ba34608715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:09.835022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3e837794-67d0-436c-b630-e0ba34608715 None None] MFA Rules not processed for user `43048122a82e4562babb240ff090d5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:09.837163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3e837794-67d0-436c-b630-e0ba34608715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:09.867991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:09.933286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 659/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Sep 1 08:07:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:09.942422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68963e5-d735-4a0c-99d4-55cfea7c1a1f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:09.944802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b68963e5-d735-4a0c-99d4-55cfea7c1a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:10.093221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68963e5-d735-4a0c-99d4-55cfea7c1a1f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:10.186358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc29e66-fd6e-4b6a-a190-8928cc023e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:10.187259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc29e66-fd6e-4b6a-a190-8928cc023e40 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:10.187718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc29e66-fd6e-4b6a-a190-8928cc023e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:10.188135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc29e66-fd6e-4b6a-a190-8928cc023e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:10.190023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cfc29e66-fd6e-4b6a-a190-8928cc023e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:10.259410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:10.332613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc29e66-fd6e-4b6a-a190-8928cc023e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:10.334307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc29e66-fd6e-4b6a-a190-8928cc023e40 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:10.361271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 652/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:12.735318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce6634-f320-4e58-a67c-71e372ce4794 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:12.735880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce6634-f320-4e58-a67c-71e372ce4794 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:12.736022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce6634-f320-4e58-a67c-71e372ce4794 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:12.737271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 660/1312] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:12.742950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3576ba-68ef-402f-9a7c-324f866304e4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:12.743408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3576ba-68ef-402f-9a7c-324f866304e4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:12.743509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3576ba-68ef-402f-9a7c-324f866304e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:12.829670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1f3576ba-68ef-402f-9a7c-324f866304e4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:12.830920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1f3576ba-68ef-402f-9a7c-324f866304e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:12.945261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 653/1313] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:13.231601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce6634-f320-4e58-a67c-71e372ce4794 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:13.233435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e1ce6634-f320-4e58-a67c-71e372ce4794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:13.359419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce6634-f320-4e58-a67c-71e372ce4794 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:13.437068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:13.439812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598225e8-4c17-4a4f-a797-26dce37d523c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:13.440644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598225e8-4c17-4a4f-a797-26dce37d523c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:13.441127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598225e8-4c17-4a4f-a797-26dce37d523c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:13.441622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598225e8-4c17-4a4f-a797-26dce37d523c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:13.443371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-598225e8-4c17-4a4f-a797-26dce37d523c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:13.558970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598225e8-4c17-4a4f-a797-26dce37d523c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:13.560417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598225e8-4c17-4a4f-a797-26dce37d523c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:13.580442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 661/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:15.853766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865923a-3927-4a86-a09b-4e1eb27dc774 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:15.854341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865923a-3927-4a86-a09b-4e1eb27dc774 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:15.854623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865923a-3927-4a86-a09b-4e1eb27dc774 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:15.856047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 654/1315] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:15.861704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221225c-7a5c-4938-a225-e8897bdcc99a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:15.862165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221225c-7a5c-4938-a225-e8897bdcc99a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:15.862286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221225c-7a5c-4938-a225-e8897bdcc99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:15.931837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f221225c-7a5c-4938-a225-e8897bdcc99a None None] MFA Rules not processed for user `77862a319a1646ef8dc2149d2122db07`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:15.933093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f221225c-7a5c-4938-a225-e8897bdcc99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:15.990682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:16.036821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 662/1316] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:16.322627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865923a-3927-4a86-a09b-4e1eb27dc774 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:16.324151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9865923a-3927-4a86-a09b-4e1eb27dc774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:16.334391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:16.470488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865923a-3927-4a86-a09b-4e1eb27dc774 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:16.567918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87abe65-e82c-4dbb-b452-cd20f32a8517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:16.568450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abe65-e82c-4dbb-b452-cd20f32a8517 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:16.568725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abe65-e82c-4dbb-b452-cd20f32a8517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:16.568996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87abe65-e82c-4dbb-b452-cd20f32a8517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:16.571225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a87abe65-e82c-4dbb-b452-cd20f32a8517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:16.640349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:16.692330 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87abe65-e82c-4dbb-b452-cd20f32a8517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:16.693789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87abe65-e82c-4dbb-b452-cd20f32a8517 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:16.713453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 655/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:20.083040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6583e-d000-4cb8-9583-944d5bc0d65e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:20.083676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6583e-d000-4cb8-9583-944d5bc0d65e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:20.083676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6583e-d000-4cb8-9583-944d5bc0d65e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:20.084988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 663/1318] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:07:20.091129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e7ad-201e-48d2-b3bc-f1b32cf98256 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:20.092755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e7ad-201e-48d2-b3bc-f1b32cf98256 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:20.093081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e7ad-201e-48d2-b3bc-f1b32cf98256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:20.165779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d879e7ad-201e-48d2-b3bc-f1b32cf98256 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:20.167055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d879e7ad-201e-48d2-b3bc-f1b32cf98256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:20.286875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 656/1319] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:07:20.592793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322d340-cd0f-4601-bec1-1b87a382ad9e None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:20.592793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322d340-cd0f-4601-bec1-1b87a382ad9e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:20.593152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322d340-cd0f-4601-bec1-1b87a382ad9e None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:20.594721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 664/1320] 10.222.0.36 () {54 vars in 965 bytes} [Thu Sep 1 08:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:07:20.605555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a813b-e716-4dd2-ba5e-b179c0abba0b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:20.606056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a813b-e716-4dd2-ba5e-b179c0abba0b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:20.606613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a813b-e716-4dd2-ba5e-b179c0abba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:20.635841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:20.700968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ae2a813b-e716-4dd2-ba5e-b179c0abba0b None None] MFA Rules not processed for user `43048122a82e4562babb240ff090d5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:20.702267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae2a813b-e716-4dd2-ba5e-b179c0abba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:20.792317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 657/1321] 10.222.0.36 () {58 vars in 1062 bytes} [Thu Sep 1 08:07:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:20.801847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322d340-cd0f-4601-bec1-1b87a382ad9e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:20.803444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6322d340-cd0f-4601-bec1-1b87a382ad9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:20.917352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322d340-cd0f-4601-bec1-1b87a382ad9e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:20.993725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66d5e0-3660-4ff1-a558-e144533ca04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:20.994362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d5e0-3660-4ff1-a558-e144533ca04f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:20.994640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d5e0-3660-4ff1-a558-e144533ca04f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:20.994909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66d5e0-3660-4ff1-a558-e144533ca04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:20.996512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ea66d5e0-3660-4ff1-a558-e144533ca04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:21.004252 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:21.112905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66d5e0-3660-4ff1-a558-e144533ca04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:21.114392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66d5e0-3660-4ff1-a558-e144533ca04f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:21.135083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 665/1322] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:24.385347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b3da-ef60-47d8-9198-113aa64432f9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:24.385944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b3da-ef60-47d8-9198-113aa64432f9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:24.385944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346b3da-ef60-47d8-9198-113aa64432f9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:24.387390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 658/1323] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:24.393458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f2bf-e11a-49b0-b090-f7a4a7e72f1a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:24.394058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f2bf-e11a-49b0-b090-f7a4a7e72f1a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:24.394058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274f2bf-e11a-49b0-b090-f7a4a7e72f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:24.480218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9274f2bf-e11a-49b0-b090-f7a4a7e72f1a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:24.481464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9274f2bf-e11a-49b0-b090-f7a4a7e72f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:24.557251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:24.608609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 666/1324] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:24.909141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b3da-ef60-47d8-9198-113aa64432f9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:24.910757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f346b3da-ef60-47d8-9198-113aa64432f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:25.031013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346b3da-ef60-47d8-9198-113aa64432f9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:25.044722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:25.115665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbcca0-ed70-4079-87c9-f266a448099b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:25.116797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbcca0-ed70-4079-87c9-f266a448099b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:25.117081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbcca0-ed70-4079-87c9-f266a448099b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:25.117355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbcca0-ed70-4079-87c9-f266a448099b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:25.119072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-affbcca0-ed70-4079-87c9-f266a448099b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:25.238694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbcca0-ed70-4079-87c9-f266a448099b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:25.240101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbcca0-ed70-4079-87c9-f266a448099b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:25.264419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 659/1325] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:27.457022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba436979-2fe9-4e20-a368-093543bb6356 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:27.457789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba436979-2fe9-4e20-a368-093543bb6356 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:27.457789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba436979-2fe9-4e20-a368-093543bb6356 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:27.459181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 667/1326] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:27.465545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300fc74-daea-4ee8-a00a-6bdfa7473b4b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:27.466062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300fc74-daea-4ee8-a00a-6bdfa7473b4b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:27.466164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300fc74-daea-4ee8-a00a-6bdfa7473b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:27.516341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:27.548580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8300fc74-daea-4ee8-a00a-6bdfa7473b4b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:27.549761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8300fc74-daea-4ee8-a00a-6bdfa7473b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:27.659025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 660/1327] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:07:27.947889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba436979-2fe9-4e20-a368-093543bb6356 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:27.949351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ba436979-2fe9-4e20-a368-093543bb6356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:28.071818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba436979-2fe9-4e20-a368-093543bb6356 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:28.151592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01742c94-ec28-4d52-bea0-d48daafbfd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:28.152220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01742c94-ec28-4d52-bea0-d48daafbfd64 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:28.152503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01742c94-ec28-4d52-bea0-d48daafbfd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:28.152782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01742c94-ec28-4d52-bea0-d48daafbfd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:28.154496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-01742c94-ec28-4d52-bea0-d48daafbfd64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:28.173112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:28.271554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01742c94-ec28-4d52-bea0-d48daafbfd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:28.273166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01742c94-ec28-4d52-bea0-d48daafbfd64 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:28.292446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 668/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:30.283273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059711-bab4-4945-a6df-b74ec5d9aa5c None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:30.283835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059711-bab4-4945-a6df-b74ec5d9aa5c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:30.283835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89059711-bab4-4945-a6df-b74ec5d9aa5c None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:30.285131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 661/1329] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:30.290943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7737-587e-498e-b75d-c6c3f217a444 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:30.291377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7737-587e-498e-b75d-c6c3f217a444 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:30.291469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7737-587e-498e-b75d-c6c3f217a444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:30.360114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7c0b7737-587e-498e-b75d-c6c3f217a444 None None] MFA Rules not processed for user `77862a319a1646ef8dc2149d2122db07`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:30.361305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7c0b7737-587e-498e-b75d-c6c3f217a444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:30.427989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:30.462670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 669/1330] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:30.757859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89059711-bab4-4945-a6df-b74ec5d9aa5c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:30.759469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-89059711-bab4-4945-a6df-b74ec5d9aa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:30.889447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89059711-bab4-4945-a6df-b74ec5d9aa5c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:30.910759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:30.968732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cee03-5660-4f41-83bf-1b6736879d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:30.969334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cee03-5660-4f41-83bf-1b6736879d86 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:30.969607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cee03-5660-4f41-83bf-1b6736879d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:30.969876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cee03-5660-4f41-83bf-1b6736879d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:30.971488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-949cee03-5660-4f41-83bf-1b6736879d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:31.094848 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cee03-5660-4f41-83bf-1b6736879d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:31.096508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cee03-5660-4f41-83bf-1b6736879d86 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:31.115968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 662/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:33.335338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5004857-c1f2-4de1-8d0d-7032cf201ef8 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:33.335760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5004857-c1f2-4de1-8d0d-7032cf201ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:33.335886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5004857-c1f2-4de1-8d0d-7032cf201ef8 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:33.337244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 670/1332] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:33.342585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1522993-72f5-41ce-a32a-cbb1c6f2b395 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:33.343026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1522993-72f5-41ce-a32a-cbb1c6f2b395 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:33.343142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1522993-72f5-41ce-a32a-cbb1c6f2b395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:33.411038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:33.414451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b1522993-72f5-41ce-a32a-cbb1c6f2b395 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:33.416359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b1522993-72f5-41ce-a32a-cbb1c6f2b395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:33.525110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 663/1333] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:33.804337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5004857-c1f2-4de1-8d0d-7032cf201ef8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:33.805890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e5004857-c1f2-4de1-8d0d-7032cf201ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:33.911477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5004857-c1f2-4de1-8d0d-7032cf201ef8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:33.984845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ee45d-60ac-4d60-b0e2-f8cd53130140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:33.985450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ee45d-60ac-4d60-b0e2-f8cd53130140 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:33.985725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ee45d-60ac-4d60-b0e2-f8cd53130140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:33.985995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ee45d-60ac-4d60-b0e2-f8cd53130140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:33.987621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9f6ee45d-60ac-4d60-b0e2-f8cd53130140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:34.015075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:34.098110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ee45d-60ac-4d60-b0e2-f8cd53130140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:34.099899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ee45d-60ac-4d60-b0e2-f8cd53130140 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:34.119232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 671/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:36.124403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1a2e1-4ed8-44fb-904b-1714727fb029 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:36.124938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1a2e1-4ed8-44fb-904b-1714727fb029 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:36.124938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1a2e1-4ed8-44fb-904b-1714727fb029 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:36.126337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 664/1335] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:36.132839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465390d-9389-420a-9c5e-04765e8e916c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:36.133334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465390d-9389-420a-9c5e-04765e8e916c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:36.133426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465390d-9389-420a-9c5e-04765e8e916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:36.205046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9465390d-9389-420a-9c5e-04765e8e916c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:36.206305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9465390d-9389-420a-9c5e-04765e8e916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:36.287149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:36.312292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 672/1336] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:36.604728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1a2e1-4ed8-44fb-904b-1714727fb029 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:36.606288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-15e1a2e1-4ed8-44fb-904b-1714727fb029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:36.720538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1a2e1-4ed8-44fb-904b-1714727fb029 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:36.752138 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:36.802990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78ced4-e45c-4014-bd03-d404651318d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:36.803598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78ced4-e45c-4014-bd03-d404651318d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:36.803875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78ced4-e45c-4014-bd03-d404651318d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:36.804148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78ced4-e45c-4014-bd03-d404651318d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:36.805746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1d78ced4-e45c-4014-bd03-d404651318d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:36.930649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78ced4-e45c-4014-bd03-d404651318d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:36.933341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78ced4-e45c-4014-bd03-d404651318d2 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:36.967056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 665/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:39.367972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5794f-065c-4555-910e-a990877b25b7 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:39.368495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5794f-065c-4555-910e-a990877b25b7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:39.368602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5794f-065c-4555-910e-a990877b25b7 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:39.369867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 673/1338] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:39.375083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1939-5403-4e32-b21e-61cb440a8344 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:39.375502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1939-5403-4e32-b21e-61cb440a8344 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:39.375627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a1939-5403-4e32-b21e-61cb440a8344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:39.448910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-581a1939-5403-4e32-b21e-61cb440a8344 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:39.450136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-581a1939-5403-4e32-b21e-61cb440a8344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:39.461497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:39.554674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 666/1339] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:39.835982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5794f-065c-4555-910e-a990877b25b7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:39.837518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7de5794f-065c-4555-910e-a990877b25b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:39.961463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5794f-065c-4555-910e-a990877b25b7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:40.037881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e967e-14de-4cfc-bb31-2f611d53de9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:40.038530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e967e-14de-4cfc-bb31-2f611d53de9f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:40.038806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e967e-14de-4cfc-bb31-2f611d53de9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:40.039075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e967e-14de-4cfc-bb31-2f611d53de9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:40.040687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e51e967e-14de-4cfc-bb31-2f611d53de9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:40.078735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:40.154937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e967e-14de-4cfc-bb31-2f611d53de9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:40.156387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e967e-14de-4cfc-bb31-2f611d53de9f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:40.175224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 674/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:44.412191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919d823-c82c-4ce6-b47b-54f7160be3d0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:44.412872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919d823-c82c-4ce6-b47b-54f7160be3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:44.412872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919d823-c82c-4ce6-b47b-54f7160be3d0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:44.414096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 667/1341] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:44.421369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa6f78-7664-499e-b09e-defb503ac520 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:44.421924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa6f78-7664-499e-b09e-defb503ac520 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:44.422114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa6f78-7664-499e-b09e-defb503ac520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:44.498261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1baa6f78-7664-499e-b09e-defb503ac520 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:44.499517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1baa6f78-7664-499e-b09e-defb503ac520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:44.595692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:44.612469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 675/1342] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:44.901643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919d823-c82c-4ce6-b47b-54f7160be3d0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:44.903233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f919d823-c82c-4ce6-b47b-54f7160be3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:45.022300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919d823-c82c-4ce6-b47b-54f7160be3d0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:45.062937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:45.102402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899533-2518-44c0-b23d-3a0f5fca2170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:45.103010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899533-2518-44c0-b23d-3a0f5fca2170 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:45.103289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899533-2518-44c0-b23d-3a0f5fca2170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:45.103551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899533-2518-44c0-b23d-3a0f5fca2170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:45.105149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-07899533-2518-44c0-b23d-3a0f5fca2170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:45.219206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899533-2518-44c0-b23d-3a0f5fca2170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:45.220552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899533-2518-44c0-b23d-3a0f5fca2170 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:45.240738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 668/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:47.930089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673a64-72b1-418c-a16d-a7a85c014811 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:47.930817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673a64-72b1-418c-a16d-a7a85c014811 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:47.930817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f673a64-72b1-418c-a16d-a7a85c014811 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:47.932067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 676/1344] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:47.938115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030914b-d5bb-40d1-9871-28f86fc75ad2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:47.938712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030914b-d5bb-40d1-9871-28f86fc75ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:47.938808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030914b-d5bb-40d1-9871-28f86fc75ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:48.015431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a030914b-d5bb-40d1-9871-28f86fc75ad2 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:48.016688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a030914b-d5bb-40d1-9871-28f86fc75ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:48.036500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:48.124666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 669/1345] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:48.411704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673a64-72b1-418c-a16d-a7a85c014811 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:48.413556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3f673a64-72b1-418c-a16d-a7a85c014811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:48.531068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f673a64-72b1-418c-a16d-a7a85c014811 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:48.617054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f97cf0-9f8b-4286-9170-8c716fdc953a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:48.617652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f97cf0-9f8b-4286-9170-8c716fdc953a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:48.617928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f97cf0-9f8b-4286-9170-8c716fdc953a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:48.618199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f97cf0-9f8b-4286-9170-8c716fdc953a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:48.619848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-29f97cf0-9f8b-4286-9170-8c716fdc953a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:48.670381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:48.744068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f97cf0-9f8b-4286-9170-8c716fdc953a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:48.745512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f97cf0-9f8b-4286-9170-8c716fdc953a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:48.765119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 677/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:52.795015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057938-f55e-48f6-8062-15f7669b49b6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:52.799685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057938-f55e-48f6-8062-15f7669b49b6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:52.799685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057938-f55e-48f6-8062-15f7669b49b6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:52.799685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 670/1347] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:52.803691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672060c-ed8b-414c-a14b-2bb9ae6c5b30 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:52.804207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672060c-ed8b-414c-a14b-2bb9ae6c5b30 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:52.804207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672060c-ed8b-414c-a14b-2bb9ae6c5b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:52.892643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b672060c-ed8b-414c-a14b-2bb9ae6c5b30 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:52.893861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b672060c-ed8b-414c-a14b-2bb9ae6c5b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:53.004243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:53.007879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 678/1348] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:07:53.298704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057938-f55e-48f6-8062-15f7669b49b6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:07:53.300325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8d057938-f55e-48f6-8062-15f7669b49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:53.442171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057938-f55e-48f6-8062-15f7669b49b6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:07:53.506679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:53.536218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1c8a7-b525-4ac8-8afd-bf2dd689629f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:07:53.537478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c8a7-b525-4ac8-8afd-bf2dd689629f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:53.537923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c8a7-b525-4ac8-8afd-bf2dd689629f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:53.538328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1c8a7-b525-4ac8-8afd-bf2dd689629f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:53.541128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fbd1c8a7-b525-4ac8-8afd-bf2dd689629f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:53.677247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1c8a7-b525-4ac8-8afd-bf2dd689629f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:07:53.678744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1c8a7-b525-4ac8-8afd-bf2dd689629f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:07:53.698642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 671/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:07:58.905117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320ac62-7b6f-4fe9-b3e7-41c29d9a0581 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:58.905614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320ac62-7b6f-4fe9-b3e7-41c29d9a0581 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:58.905716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320ac62-7b6f-4fe9-b3e7-41c29d9a0581 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:58.907289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 679/1350] 10.222.0.36 () {54 vars in 921 bytes} [Thu Sep 1 08:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:07:58.915104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ccc2-e473-40ae-a610-548603e9bc9c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:07:58.916069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ccc2-e473-40ae-a610-548603e9bc9c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:07:58.916344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ccc2-e473-40ae-a610-548603e9bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:07:59.041042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fff7ccc2-e473-40ae-a610-548603e9bc9c None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:07:59.042418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fff7ccc2-e473-40ae-a610-548603e9bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:07:59.073731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:07:59.206896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 672/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Sep 1 08:07:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:04.101155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839bf0-df57-4863-8377-d5447c285694 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:04.101751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839bf0-df57-4863-8377-d5447c285694 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:04.101751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17839bf0-df57-4863-8377-d5447c285694 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:04.103310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 680/1352] 10.222.0.36 () {54 vars in 921 bytes} [Thu Sep 1 08:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:04.109786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434052-14e6-4cdb-9451-276f915310df None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:04.110709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434052-14e6-4cdb-9451-276f915310df None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:04.110992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434052-14e6-4cdb-9451-276f915310df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:04.203454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-61434052-14e6-4cdb-9451-276f915310df None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:04.205001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61434052-14e6-4cdb-9451-276f915310df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:04.294280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:04.339171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 673/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Sep 1 08:08:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:05.943364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95c604-e524-4166-8909-53f9cc30e0d2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:05.944175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95c604-e524-4166-8909-53f9cc30e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:05.945079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95c604-e524-4166-8909-53f9cc30e0d2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:05.947002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 681/1354] 10.222.0.36 () {54 vars in 921 bytes} [Thu Sep 1 08:08:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:05.954125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc1b30-45ac-4507-9ba2-fadf0b01cbf0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:05.954746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc1b30-45ac-4507-9ba2-fadf0b01cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:05.954746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc1b30-45ac-4507-9ba2-fadf0b01cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:06.038800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c5cc1b30-45ac-4507-9ba2-fadf0b01cbf0 None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:06.040023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c5cc1b30-45ac-4507-9ba2-fadf0b01cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:06.179584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 674/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Sep 1 08:08:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:09.793327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3048-0031-4ffd-9d81-072e191a4d83 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:09.794228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3048-0031-4ffd-9d81-072e191a4d83 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:09.794743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3048-0031-4ffd-9d81-072e191a4d83 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:09.796104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 682/1356] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:09.801590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3e72-e5da-4710-b4ee-bf98b163ebb1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:09.802015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3e72-e5da-4710-b4ee-bf98b163ebb1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:09.802268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c3e72-e5da-4710-b4ee-bf98b163ebb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:09.839898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:09.878789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1f9c3e72-e5da-4710-b4ee-bf98b163ebb1 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:09.880207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1f9c3e72-e5da-4710-b4ee-bf98b163ebb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:10.064201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 675/1357] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:10.390196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9576f0-1793-49f9-a9bd-d031671e9454 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:10.390650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9576f0-1793-49f9-a9bd-d031671e9454 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:10.390950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9576f0-1793-49f9-a9bd-d031671e9454 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:10.392311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 683/1358] 10.222.0.36 () {54 vars in 962 bytes} [Thu Sep 1 08:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:10.402137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99373e67-fe27-4526-bd3f-3536b8e460e5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:10.402587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99373e67-fe27-4526-bd3f-3536b8e460e5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:10.403089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99373e67-fe27-4526-bd3f-3536b8e460e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:10.516209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-99373e67-fe27-4526-bd3f-3536b8e460e5 None None] MFA Rules not processed for user `3a545f5fde0d432fbe31819eb5c7c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:10.517579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-99373e67-fe27-4526-bd3f-3536b8e460e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:10.578964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:10.683650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 676/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Sep 1 08:08:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:10.691975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9576f0-1793-49f9-a9bd-d031671e9454 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:10.693946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8e9576f0-1793-49f9-a9bd-d031671e9454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:10.875743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9576f0-1793-49f9-a9bd-d031671e9454 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:10.971625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:11.033490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911c914-fda5-4019-9b73-0aa60b4e0979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:11.034371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c914-fda5-4019-9b73-0aa60b4e0979 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:11.034641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c914-fda5-4019-9b73-0aa60b4e0979 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:11.034968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c914-fda5-4019-9b73-0aa60b4e0979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:11.037749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e911c914-fda5-4019-9b73-0aa60b4e0979 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:11.155358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911c914-fda5-4019-9b73-0aa60b4e0979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:11.157002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911c914-fda5-4019-9b73-0aa60b4e0979 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:11.192565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 684/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:13.801770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86790-34da-41a9-9fbd-8796c1aebe57 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:13.802699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86790-34da-41a9-9fbd-8796c1aebe57 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:13.802699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db86790-34da-41a9-9fbd-8796c1aebe57 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:13.804804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 677/1361] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:13.813829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495c576-a006-46fb-b3a9-371ea28f6cd1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:13.814421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495c576-a006-46fb-b3a9-371ea28f6cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:13.815153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495c576-a006-46fb-b3a9-371ea28f6cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:13.973783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d495c576-a006-46fb-b3a9-371ea28f6cd1 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:13.978550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d495c576-a006-46fb-b3a9-371ea28f6cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:14.065863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:14.201577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 685/1362] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:14.518923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db86790-34da-41a9-9fbd-8796c1aebe57 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:14.520925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4db86790-34da-41a9-9fbd-8796c1aebe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:14.760085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db86790-34da-41a9-9fbd-8796c1aebe57 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:14.773840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:14.961643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caea5f2-ac4e-4b1b-a6ab-91b1155124e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:14.962713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caea5f2-ac4e-4b1b-a6ab-91b1155124e3 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:14.963524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caea5f2-ac4e-4b1b-a6ab-91b1155124e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:14.963717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caea5f2-ac4e-4b1b-a6ab-91b1155124e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:14.967446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7caea5f2-ac4e-4b1b-a6ab-91b1155124e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:15.125943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caea5f2-ac4e-4b1b-a6ab-91b1155124e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:15.127277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caea5f2-ac4e-4b1b-a6ab-91b1155124e3 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:15.158671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 678/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:17.692041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5870-583f-483e-953c-93b23cb1a643 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:17.692731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5870-583f-483e-953c-93b23cb1a643 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:17.692731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5870-583f-483e-953c-93b23cb1a643 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:17.694418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 686/1364] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:17.701131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c876467-ac92-4190-af65-cd7ebd1ad0a2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:17.701695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c876467-ac92-4190-af65-cd7ebd1ad0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:17.702436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c876467-ac92-4190-af65-cd7ebd1ad0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:17.734551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:17.833764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9c876467-ac92-4190-af65-cd7ebd1ad0a2 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:17.836274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9c876467-ac92-4190-af65-cd7ebd1ad0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:18.034318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 679/1365] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:18.340735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a27f-e978-413b-95a5-60c68fdff9d4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:18.341016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a27f-e978-413b-95a5-60c68fdff9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:18.341466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a27f-e978-413b-95a5-60c68fdff9d4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:18.343274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 687/1366] 10.222.0.36 () {54 vars in 962 bytes} [Thu Sep 1 08:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:18.351756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381d5d-24ca-4743-b359-8c4b5470185e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:18.352290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381d5d-24ca-4743-b359-8c4b5470185e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:18.352831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381d5d-24ca-4743-b359-8c4b5470185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:18.477050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cc381d5d-24ca-4743-b359-8c4b5470185e None None] MFA Rules not processed for user `3a545f5fde0d432fbe31819eb5c7c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:18.478495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cc381d5d-24ca-4743-b359-8c4b5470185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:18.534573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:18.639281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 680/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Sep 1 08:08:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:18.647890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a27f-e978-413b-95a5-60c68fdff9d4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:18.649586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a871a27f-e978-413b-95a5-60c68fdff9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:18.809884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a27f-e978-413b-95a5-60c68fdff9d4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:18.832848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:18.943294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27afcf58-f98d-4bf1-b870-913c2c62ee52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:18.943847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afcf58-f98d-4bf1-b870-913c2c62ee52 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:18.944148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afcf58-f98d-4bf1-b870-913c2c62ee52 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:18.944393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27afcf58-f98d-4bf1-b870-913c2c62ee52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:18.946182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-27afcf58-f98d-4bf1-b870-913c2c62ee52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:19.079890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afcf58-f98d-4bf1-b870-913c2c62ee52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:19.082201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27afcf58-f98d-4bf1-b870-913c2c62ee52 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:19.113013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 688/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:19.392157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8d09-0ae2-4e79-a59f-7082ab7e99e8 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:19.392987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8d09-0ae2-4e79-a59f-7082ab7e99e8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:19.392987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8d09-0ae2-4e79-a59f-7082ab7e99e8 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:19.394504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 681/1369] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:08:19.401334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8135a-1400-4938-95e1-6297f6f25418 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:19.401684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8135a-1400-4938-95e1-6297f6f25418 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:19.402051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8135a-1400-4938-95e1-6297f6f25418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:19.447283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:19.508146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7cc8135a-1400-4938-95e1-6297f6f25418 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:19.510286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7cc8135a-1400-4938-95e1-6297f6f25418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:19.706834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 689/1370] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:20.333757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eadcc9-f7ea-4c9d-b203-a732f5898a27 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:20.334919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eadcc9-f7ea-4c9d-b203-a732f5898a27 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:20.335443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eadcc9-f7ea-4c9d-b203-a732f5898a27 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:20.337247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 682/1371] 10.222.0.36 () {54 vars in 964 bytes} [Thu Sep 1 08:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:20.342823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f242-4b31-4722-9a9e-40110c8ae721 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:20.343678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f242-4b31-4722-9a9e-40110c8ae721 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:20.344104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f242-4b31-4722-9a9e-40110c8ae721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:20.439947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4697f242-4b31-4722-9a9e-40110c8ae721 None None] MFA Rules not processed for user `146b6b09371b4deb940ad1fb924ea984`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:20.441223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4697f242-4b31-4722-9a9e-40110c8ae721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:20.514645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:20.568228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 690/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Sep 1 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:20.604811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eadcc9-f7ea-4c9d-b203-a732f5898a27 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:20.609287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-03eadcc9-f7ea-4c9d-b203-a732f5898a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:20.762088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eadcc9-f7ea-4c9d-b203-a732f5898a27 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:20.811711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:20.852616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7e88e-d58d-421b-ac38-68d4d341d1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:20.853236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e88e-d58d-421b-ac38-68d4d341d1fd service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:20.853524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e88e-d58d-421b-ac38-68d4d341d1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:20.853791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7e88e-d58d-421b-ac38-68d4d341d1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:20.855472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dce7e88e-d58d-421b-ac38-68d4d341d1fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:20.974589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7e88e-d58d-421b-ac38-68d4d341d1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:20.976928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7e88e-d58d-421b-ac38-68d4d341d1fd service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:20.995864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 683/1373] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:21.531691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69668b2-8712-4069-b3da-2f415e00c8c9 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:21.532340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69668b2-8712-4069-b3da-2f415e00c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:21.532340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69668b2-8712-4069-b3da-2f415e00c8c9 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:21.533722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 691/1374] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:21.541506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c36b2-283b-4fd0-b53e-1dc05996f681 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:21.541868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c36b2-283b-4fd0-b53e-1dc05996f681 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:21.542209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c36b2-283b-4fd0-b53e-1dc05996f681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:21.624142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-376c36b2-283b-4fd0-b53e-1dc05996f681 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:21.625248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-376c36b2-283b-4fd0-b53e-1dc05996f681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:21.650290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:21.735633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 684/1375] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:22.024740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69668b2-8712-4069-b3da-2f415e00c8c9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:22.026526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c69668b2-8712-4069-b3da-2f415e00c8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:22.186041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69668b2-8712-4069-b3da-2f415e00c8c9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:22.239314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:22.305200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e1f5b-0c48-465b-88bd-01439c30c215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:22.305723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e1f5b-0c48-465b-88bd-01439c30c215 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:22.306005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e1f5b-0c48-465b-88bd-01439c30c215 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:22.306311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e1f5b-0c48-465b-88bd-01439c30c215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:22.307923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ab1e1f5b-0c48-465b-88bd-01439c30c215 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:22.402868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e1f5b-0c48-465b-88bd-01439c30c215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:22.404493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e1f5b-0c48-465b-88bd-01439c30c215 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:22.425241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 692/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:24.448612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7286e-4fa2-4e98-a34d-e8a8ae49a043 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:24.449115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7286e-4fa2-4e98-a34d-e8a8ae49a043 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:24.449115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7286e-4fa2-4e98-a34d-e8a8ae49a043 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:24.450976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 685/1377] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:24.456898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11ddd-f851-4fa6-80ed-36bedc9045fa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:24.457490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11ddd-f851-4fa6-80ed-36bedc9045fa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:24.457490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c11ddd-f851-4fa6-80ed-36bedc9045fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:24.539050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a8c11ddd-f851-4fa6-80ed-36bedc9045fa None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:24.541015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a8c11ddd-f851-4fa6-80ed-36bedc9045fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:24.556833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:24.677909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 693/1378] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:25.007432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7286e-4fa2-4e98-a34d-e8a8ae49a043 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:25.010162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3de7286e-4fa2-4e98-a34d-e8a8ae49a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:25.212825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7286e-4fa2-4e98-a34d-e8a8ae49a043 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:25.217332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:25.351734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d55f3-7f5f-4fde-930b-a2c9438751c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:25.351734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d55f3-7f5f-4fde-930b-a2c9438751c2 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:25.352188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d55f3-7f5f-4fde-930b-a2c9438751c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:25.352547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d55f3-7f5f-4fde-930b-a2c9438751c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:25.354352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-961d55f3-7f5f-4fde-930b-a2c9438751c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:25.465605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d55f3-7f5f-4fde-930b-a2c9438751c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:25.467427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d55f3-7f5f-4fde-930b-a2c9438751c2 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:25.488846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 686/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:27.704928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788806-e28b-4247-9f16-e5532e36e61f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:27.706166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788806-e28b-4247-9f16-e5532e36e61f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:27.706166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788806-e28b-4247-9f16-e5532e36e61f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:27.712956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 694/1380] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:27.713580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60c59f-47f1-49b0-bf5d-ed408eb5e65f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:27.714327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60c59f-47f1-49b0-bf5d-ed408eb5e65f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:27.714327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60c59f-47f1-49b0-bf5d-ed408eb5e65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:27.729364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:27.799117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fd60c59f-47f1-49b0-bf5d-ed408eb5e65f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:27.800240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fd60c59f-47f1-49b0-bf5d-ed408eb5e65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:27.909530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 687/1381] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:28.452360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788806-e28b-4247-9f16-e5532e36e61f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:28.453861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a2788806-e28b-4247-9f16-e5532e36e61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:28.624683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:28.643876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788806-e28b-4247-9f16-e5532e36e61f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:28.792086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd076e25-ef25-474a-ac5a-0c30d20b1254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:28.792941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076e25-ef25-474a-ac5a-0c30d20b1254 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:28.793037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076e25-ef25-474a-ac5a-0c30d20b1254 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:28.793311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd076e25-ef25-474a-ac5a-0c30d20b1254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:28.794991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bd076e25-ef25-474a-ac5a-0c30d20b1254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:28.926822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd076e25-ef25-474a-ac5a-0c30d20b1254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:28.928360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd076e25-ef25-474a-ac5a-0c30d20b1254 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:28.943439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:28.954546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 695/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:31.237699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9fbaa-07dc-487f-b781-b6f84cfdc69a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:31.238360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9fbaa-07dc-487f-b781-b6f84cfdc69a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:31.238360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9fbaa-07dc-487f-b781-b6f84cfdc69a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:31.239607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 688/1383] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:31.246212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820f6d-a71a-4c23-8ef0-256683332172 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:31.246825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820f6d-a71a-4c23-8ef0-256683332172 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:31.246825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b820f6d-a71a-4c23-8ef0-256683332172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:31.339363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9b820f6d-a71a-4c23-8ef0-256683332172 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:31.341242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9b820f6d-a71a-4c23-8ef0-256683332172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:31.494371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 696/1384] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:31.890378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9fbaa-07dc-487f-b781-b6f84cfdc69a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:31.891856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-72d9fbaa-07dc-487f-b781-b6f84cfdc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:32.000468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:32.143983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9fbaa-07dc-487f-b781-b6f84cfdc69a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:32.309319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa14ef-70a5-47ec-842d-6b921a3df292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:32.310183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa14ef-70a5-47ec-842d-6b921a3df292 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:32.310586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa14ef-70a5-47ec-842d-6b921a3df292 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:32.310961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa14ef-70a5-47ec-842d-6b921a3df292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:32.313204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c0aa14ef-70a5-47ec-842d-6b921a3df292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:32.391804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:32.457870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa14ef-70a5-47ec-842d-6b921a3df292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:32.460665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa14ef-70a5-47ec-842d-6b921a3df292 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:32.484555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 689/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:34.589379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb792-2e17-489c-90e6-c98718d53c64 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:34.589937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb792-2e17-489c-90e6-c98718d53c64 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:34.590256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb792-2e17-489c-90e6-c98718d53c64 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:34.592104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 697/1386] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:34.598113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d1e4-3b4e-4cdf-a8e9-bde5cf5f43ee None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:34.598670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d1e4-3b4e-4cdf-a8e9-bde5cf5f43ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:34.598670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909d1e4-3b4e-4cdf-a8e9-bde5cf5f43ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:34.686549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8909d1e4-3b4e-4cdf-a8e9-bde5cf5f43ee None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:34.687817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8909d1e4-3b4e-4cdf-a8e9-bde5cf5f43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:34.827921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 690/1387] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:35.147271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb792-2e17-489c-90e6-c98718d53c64 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:35.150455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1fedb792-2e17-489c-90e6-c98718d53c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:35.246786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:35.347613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb792-2e17-489c-90e6-c98718d53c64 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:35.471258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e2e6c-7104-4989-966e-b5e7f79fa860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:35.471827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e2e6c-7104-4989-966e-b5e7f79fa860 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:35.472089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e2e6c-7104-4989-966e-b5e7f79fa860 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:35.472362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e2e6c-7104-4989-966e-b5e7f79fa860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:35.474033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-265e2e6c-7104-4989-966e-b5e7f79fa860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:35.518678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:35.594083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e2e6c-7104-4989-966e-b5e7f79fa860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:35.597135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e2e6c-7104-4989-966e-b5e7f79fa860 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:35.620829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 698/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:37.083427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3959945-2b55-4d64-af31-d63bfa471df0 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.084043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3959945-2b55-4d64-af31-d63bfa471df0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.084043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3959945-2b55-4d64-af31-d63bfa471df0 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.086637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 691/1389] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:37.092595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618225b2-4a0b-4413-be04-c8cd6ab52cba None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.093105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618225b2-4a0b-4413-be04-c8cd6ab52cba None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.093217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618225b2-4a0b-4413-be04-c8cd6ab52cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.173250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-618225b2-4a0b-4413-be04-c8cd6ab52cba None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:37.174498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-618225b2-4a0b-4413-be04-c8cd6ab52cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:37.279513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 699/1390] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:37.594088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4eba3-9506-46f1-aebc-486af3f44f3a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.594088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4eba3-9506-46f1-aebc-486af3f44f3a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.594088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4eba3-9506-46f1-aebc-486af3f44f3a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.594088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 692/1391] 10.222.0.36 () {54 vars in 967 bytes} [Thu Sep 1 08:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:37.598999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b78c-a3c9-47c0-b5d4-a8e0e6fc23ee None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.599284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b78c-a3c9-47c0-b5d4-a8e0e6fc23ee None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.599586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063b78c-a3c9-47c0-b5d4-a8e0e6fc23ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.619348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:37.666400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5eb76-6761-4534-9e90-981b356441f7 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.666604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5eb76-6761-4534-9e90-981b356441f7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.666868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5eb76-6761-4534-9e90-981b356441f7 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.668202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 693/1392] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:08:37.673532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.673816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.674093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.691869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f063b78c-a3c9-47c0-b5d4-a8e0e6fc23ee None None] MFA Rules not processed for user `916a9bae3ca94918af4efdfcae19d928`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:37.693090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f063b78c-a3c9-47c0-b5d4-a8e0e6fc23ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:37.717027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:37.764738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:37.765972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:37.777130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 700/1393] 10.222.0.36 () {58 vars in 1064 bytes} [Thu Sep 1 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:37.785378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063b78c-a3c9-47c0-b5d4-a8e0e6fc23ee None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:37.794695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063b78c-a3c9-47c0-b5d4-a8e0e6fc23ee None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:37.881737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 694/1394] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:37.889021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fbff7-b509-4332-bfb2-86a7bf73beaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '916a9bae3ca94918af4efdfcae19d928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:37.889639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fbff7-b509-4332-bfb2-86a7bf73beaa service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:37.889913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fbff7-b509-4332-bfb2-86a7bf73beaa service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:37.890183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fbff7-b509-4332-bfb2-86a7bf73beaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:37.891835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6e1fbff7-b509-4332-bfb2-86a7bf73beaa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:37.934106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:38.049288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fbff7-b509-4332-bfb2-86a7bf73beaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:38.050985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fbff7-b509-4332-bfb2-86a7bf73beaa service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:38.075458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 701/1395] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:38.177104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:38.179528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:38.299778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:38.310536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79511e-08d2-40c8-9927-94cc187016f9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:38.465074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45c0c0-f10a-4bde-b429-3137fd8894a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:38.465074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c0c0-f10a-4bde-b429-3137fd8894a3 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:38.465074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c0c0-f10a-4bde-b429-3137fd8894a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:38.465074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45c0c0-f10a-4bde-b429-3137fd8894a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:38.468013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3a45c0c0-f10a-4bde-b429-3137fd8894a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:38.590749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c0c0-f10a-4bde-b429-3137fd8894a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:38.590749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45c0c0-f10a-4bde-b429-3137fd8894a3 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:38.610326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:38.617205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 695/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:38.889389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570aa47-79fc-4fe7-8ecb-36acec3bedee None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:38.889980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570aa47-79fc-4fe7-8ecb-36acec3bedee None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:38.889980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570aa47-79fc-4fe7-8ecb-36acec3bedee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:38.971412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4570aa47-79fc-4fe7-8ecb-36acec3bedee None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:38.972638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4570aa47-79fc-4fe7-8ecb-36acec3bedee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:39.075201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:39.086517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 702/1397] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:39.147463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2fcc9-3737-49a3-90a5-240e407d6891 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:39.149235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2fcc9-3737-49a3-90a5-240e407d6891 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:39.149491 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2fcc9-3737-49a3-90a5-240e407d6891 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:39.150961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 696/1398] 10.222.0.36 () {54 vars in 943 bytes} [Thu Sep 1 08:08:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:39.157852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9495f7-c229-43dd-959b-cf34f6c014da None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:39.158139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9495f7-c229-43dd-959b-cf34f6c014da None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:39.158450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9495f7-c229-43dd-959b-cf34f6c014da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:39.243111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ca9495f7-c229-43dd-959b-cf34f6c014da None None] MFA Rules not processed for user `631f5f7d18ab4574843a667ef17429ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:39.244602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ca9495f7-c229-43dd-959b-cf34f6c014da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:39.375426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 703/1399] 10.222.0.36 () {58 vars in 1040 bytes} [Thu Sep 1 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:08:39.385610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2fcc9-3737-49a3-90a5-240e407d6891 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:39.387177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-92a2fcc9-3737-49a3-90a5-240e407d6891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:39.552038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2fcc9-3737-49a3-90a5-240e407d6891 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:39.664169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:39.687068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40448f17-c24d-4ac3-a0ce-2b75ff6e8c66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:39.688009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40448f17-c24d-4ac3-a0ce-2b75ff6e8c66 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:39.688307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40448f17-c24d-4ac3-a0ce-2b75ff6e8c66 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:39.688688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40448f17-c24d-4ac3-a0ce-2b75ff6e8c66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:39.691403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-40448f17-c24d-4ac3-a0ce-2b75ff6e8c66 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:39.802029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40448f17-c24d-4ac3-a0ce-2b75ff6e8c66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:39.803794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40448f17-c24d-4ac3-a0ce-2b75ff6e8c66 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:39.813373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 697/1400] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:08:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:08:40.672926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cf863-697b-4cd7-97b2-7b02dbdbfa3d None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:40.673620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cf863-697b-4cd7-97b2-7b02dbdbfa3d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:40.673620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cf863-697b-4cd7-97b2-7b02dbdbfa3d None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:40.675054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 704/1401] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:08:40.681382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf73a8-a0e8-47bc-a89f-f8fcb2589bbf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:40.682625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf73a8-a0e8-47bc-a89f-f8fcb2589bbf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:40.682625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf73a8-a0e8-47bc-a89f-f8fcb2589bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:40.799897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2daf73a8-a0e8-47bc-a89f-f8fcb2589bbf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:40.801141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2daf73a8-a0e8-47bc-a89f-f8fcb2589bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:40.926879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:40.965621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 698/1402] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:41.268094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cf863-697b-4cd7-97b2-7b02dbdbfa3d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:41.274463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7f4cf863-697b-4cd7-97b2-7b02dbdbfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:41.365082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:41.530653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cf863-697b-4cd7-97b2-7b02dbdbfa3d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:41.705821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c8842-420a-4cb1-b1c0-fff7c3a3e3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:41.706708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8842-420a-4cb1-b1c0-fff7c3a3e3e7 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:41.707064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8842-420a-4cb1-b1c0-fff7c3a3e3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:41.707364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8842-420a-4cb1-b1c0-fff7c3a3e3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:41.709176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-759c8842-420a-4cb1-b1c0-fff7c3a3e3e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:41.734400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:41.815308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c8842-420a-4cb1-b1c0-fff7c3a3e3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:41.817188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c8842-420a-4cb1-b1c0-fff7c3a3e3e7 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:41.848686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 705/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:44.045751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85e53-0eff-402c-b67d-00dfcdf006bf None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:44.046406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85e53-0eff-402c-b67d-00dfcdf006bf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:44.046406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85e53-0eff-402c-b67d-00dfcdf006bf None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:44.047937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 699/1404] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:08:44.055150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2c8e1-7f44-47a6-90bc-6493aeee0dd9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:44.055743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2c8e1-7f44-47a6-90bc-6493aeee0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:44.056140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2c8e1-7f44-47a6-90bc-6493aeee0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:44.166221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-00c2c8e1-7f44-47a6-90bc-6493aeee0dd9 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:44.167757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-00c2c8e1-7f44-47a6-90bc-6493aeee0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:44.295857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:44.304619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 706/1405] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:44.620353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85e53-0eff-402c-b67d-00dfcdf006bf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:44.621903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8ac85e53-0eff-402c-b67d-00dfcdf006bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:44.829369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85e53-0eff-402c-b67d-00dfcdf006bf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:44.911906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:44.999060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afed9db-12b3-4da2-a57e-c80cfd8e400e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:45.000801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed9db-12b3-4da2-a57e-c80cfd8e400e service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:45.002428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed9db-12b3-4da2-a57e-c80cfd8e400e service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:45.002883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afed9db-12b3-4da2-a57e-c80cfd8e400e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:45.005558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5afed9db-12b3-4da2-a57e-c80cfd8e400e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:45.130317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afed9db-12b3-4da2-a57e-c80cfd8e400e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:45.130317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afed9db-12b3-4da2-a57e-c80cfd8e400e service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:45.149764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 700/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:08:47.226749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb3ff-698a-447d-ba09-8c680f54a1c3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:47.227479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb3ff-698a-447d-ba09-8c680f54a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:47.227643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cb3ff-698a-447d-ba09-8c680f54a1c3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:47.230071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 707/1407] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:08:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:08:47.237402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7299d-5598-44fd-b08e-9a7359b5ddc9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:47.238142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7299d-5598-44fd-b08e-9a7359b5ddc9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:47.238142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7299d-5598-44fd-b08e-9a7359b5ddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:47.351005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-08e7299d-5598-44fd-b08e-9a7359b5ddc9 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:08:47.353199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-08e7299d-5598-44fd-b08e-9a7359b5ddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:47.390923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:47.531737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 701/1408] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:08:47.932328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cb3ff-698a-447d-ba09-8c680f54a1c3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:08:47.934035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3d4cb3ff-698a-447d-ba09-8c680f54a1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:48.155366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cb3ff-698a-447d-ba09-8c680f54a1c3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:08:48.250750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:48.310329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbfd6b-0e49-4a7a-93e9-7ccb64c39e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:08:48.311139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfd6b-0e49-4a7a-93e9-7ccb64c39e98 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:08:48.311478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfd6b-0e49-4a7a-93e9-7ccb64c39e98 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:08:48.311883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfd6b-0e49-4a7a-93e9-7ccb64c39e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:08:48.314212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-17bbfd6b-0e49-4a7a-93e9-7ccb64c39e98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:08:48.442363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbfd6b-0e49-4a7a-93e9-7ccb64c39e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:08:48.444498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbfd6b-0e49-4a7a-93e9-7ccb64c39e98 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:08:48.466354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 708/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:08:57.529036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=37 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:08:58.463704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=65 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:03.735786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1fc6a-263b-4143-8096-32065ad0278d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:03.736348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1fc6a-263b-4143-8096-32065ad0278d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:03.736571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1fc6a-263b-4143-8096-32065ad0278d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:03.739180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 702/1410] 10.222.0.36 () {54 vars in 918 bytes} [Thu Sep 1 08:09:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:03.745581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190c898-f3f0-43fa-8991-4c0b078c169d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:03.746108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190c898-f3f0-43fa-8991-4c0b078c169d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:03.746215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190c898-f3f0-43fa-8991-4c0b078c169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:03.830907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4190c898-f3f0-43fa-8991-4c0b078c169d None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:03.832140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4190c898-f3f0-43fa-8991-4c0b078c169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:03.946123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 709/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Sep 1 08:09:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:03.961043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4277-52c4-4c9a-909a-f201a5ec477d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:03.961538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4277-52c4-4c9a-909a-f201a5ec477d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:03.961832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba4277-52c4-4c9a-909a-f201a5ec477d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:03.963323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 703/1412] 10.222.0.36 () {54 vars in 918 bytes} [Thu Sep 1 08:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:03.968329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182b714-8d04-474a-a8a5-250dcc476668 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:03.968620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182b714-8d04-474a-a8a5-250dcc476668 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:03.968892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182b714-8d04-474a-a8a5-250dcc476668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:04.048068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:04.053831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6182b714-8d04-474a-a8a5-250dcc476668 None None] MFA Rules not processed for user `3a545f5fde0d432fbe31819eb5c7c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:04.056464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6182b714-8d04-474a-a8a5-250dcc476668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:04.177353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 710/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Sep 1 08:09:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:06.622680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092894a-1ae5-42a9-b439-473db1fa2451 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:06.623311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092894a-1ae5-42a9-b439-473db1fa2451 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:06.623311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092894a-1ae5-42a9-b439-473db1fa2451 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:06.624536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:09:06.636536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a106-e2ad-4adb-8b1b-42eebc563f63 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:06.637101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a106-e2ad-4adb-8b1b-42eebc563f63 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:06.637214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a106-e2ad-4adb-8b1b-42eebc563f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:06.705743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f831a106-e2ad-4adb-8b1b-42eebc563f63 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:06.706997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f831a106-e2ad-4adb-8b1b-42eebc563f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:06.770454 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:06.818147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:07.116052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092894a-1ae5-42a9-b439-473db1fa2451 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:07.118747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d092894a-1ae5-42a9-b439-473db1fa2451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:07.310348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092894a-1ae5-42a9-b439-473db1fa2451 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:07.399024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:07.450648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f2105-94c5-415f-ac74-889541293410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:07.452867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f2105-94c5-415f-ac74-889541293410 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:07.453219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f2105-94c5-415f-ac74-889541293410 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:07.454031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f2105-94c5-415f-ac74-889541293410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:07.455705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-922f2105-94c5-415f-ac74-889541293410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:07.579444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f2105-94c5-415f-ac74-889541293410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:07.581087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f2105-94c5-415f-ac74-889541293410 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:07.604435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 705/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:08.676975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a4ea-a3bf-4a94-a0c5-e32c19d4c7e0 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:08.677552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a4ea-a3bf-4a94-a0c5-e32c19d4c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:08.677657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77a4ea-a3bf-4a94-a0c5-e32c19d4c7e0 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:08.678972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:08.684338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb8b9-a93c-453a-a2e7-c7576fb9528d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:08.684780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb8b9-a93c-453a-a2e7-c7576fb9528d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:08.684889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bcb8b9-a93c-453a-a2e7-c7576fb9528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:08.766765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-65bcb8b9-a93c-453a-a2e7-c7576fb9528d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:08.768028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-65bcb8b9-a93c-453a-a2e7-c7576fb9528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:08.797001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:08.873024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:09.107663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a4ea-a3bf-4a94-a0c5-e32c19d4c7e0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:09.109209 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3c77a4ea-a3bf-4a94-a0c5-e32c19d4c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:09.263682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77a4ea-a3bf-4a94-a0c5-e32c19d4c7e0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:09.305650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:09.383944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d071fa-d4ef-4fe5-ab36-9abd8ba827b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:09.384451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d071fa-d4ef-4fe5-ab36-9abd8ba827b3 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:09.384726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d071fa-d4ef-4fe5-ab36-9abd8ba827b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:09.384994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d071fa-d4ef-4fe5-ab36-9abd8ba827b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:09.386625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-82d071fa-d4ef-4fe5-ab36-9abd8ba827b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:09.483864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d071fa-d4ef-4fe5-ab36-9abd8ba827b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:09.485499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d071fa-d4ef-4fe5-ab36-9abd8ba827b3 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:09.505216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 713/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:10.427275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb510-e516-4ea4-867d-0c9711ca8ad1 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:10.427851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb510-e516-4ea4-867d-0c9711ca8ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:10.427958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281bb510-e516-4ea4-867d-0c9711ca8ad1 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:10.429450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:10.435785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a900a3-673b-4044-959a-59b7797bb34a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:10.436325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a900a3-673b-4044-959a-59b7797bb34a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:10.436325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a900a3-673b-4044-959a-59b7797bb34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:10.493470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:10.517635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-79a900a3-673b-4044-959a-59b7797bb34a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:10.518909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-79a900a3-673b-4044-959a-59b7797bb34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:10.624083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:10.780853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb510-e516-4ea4-867d-0c9711ca8ad1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:10.782435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-281bb510-e516-4ea4-867d-0c9711ca8ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:10.941170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281bb510-e516-4ea4-867d-0c9711ca8ad1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:10.955539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:11.066919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ab57f-7ba1-4c64-95c2-c38f452591e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:11.067450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab57f-7ba1-4c64-95c2-c38f452591e0 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:11.067730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab57f-7ba1-4c64-95c2-c38f452591e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:11.068002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ab57f-7ba1-4c64-95c2-c38f452591e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:11.069642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b84ab57f-7ba1-4c64-95c2-c38f452591e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:11.162857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ab57f-7ba1-4c64-95c2-c38f452591e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:11.164526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ab57f-7ba1-4c64-95c2-c38f452591e0 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:11.184334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 708/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:12.084067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfe01-65ce-4b77-b621-efd002aedd60 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:12.084599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfe01-65ce-4b77-b621-efd002aedd60 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:12.084599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbfe01-65ce-4b77-b621-efd002aedd60 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:12.085960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:12.091961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b475-4411-49af-b0d1-6d5f938b6516 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:12.092424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b475-4411-49af-b0d1-6d5f938b6516 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:12.092543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068b475-4411-49af-b0d1-6d5f938b6516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:12.112959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:12.170632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8068b475-4411-49af-b0d1-6d5f938b6516 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:12.171864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8068b475-4411-49af-b0d1-6d5f938b6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:12.269473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:12.423423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfe01-65ce-4b77-b621-efd002aedd60 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:12.424973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-42bbfe01-65ce-4b77-b621-efd002aedd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:12.536916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:12.574213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbfe01-65ce-4b77-b621-efd002aedd60 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:12.701288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf63d39-4cd0-4b31-b8b8-bf407c359022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:12.701964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf63d39-4cd0-4b31-b8b8-bf407c359022 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:12.702344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf63d39-4cd0-4b31-b8b8-bf407c359022 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:12.702670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf63d39-4cd0-4b31-b8b8-bf407c359022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:12.704754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7bf63d39-4cd0-4b31-b8b8-bf407c359022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:12.798085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:12.821505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf63d39-4cd0-4b31-b8b8-bf407c359022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:12.824488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf63d39-4cd0-4b31-b8b8-bf407c359022 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:12.857044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 716/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:13.767051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99cc2-d6c7-4d62-a9a8-d3d31f9b4d0a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:13.767681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99cc2-d6c7-4d62-a9a8-d3d31f9b4d0a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:13.767681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff99cc2-d6c7-4d62-a9a8-d3d31f9b4d0a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:13.768931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:13.774224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc033a3-39ad-4074-ba01-b968ff0d3195 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:13.774765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc033a3-39ad-4074-ba01-b968ff0d3195 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:13.774893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc033a3-39ad-4074-ba01-b968ff0d3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:13.859025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7bc033a3-39ad-4074-ba01-b968ff0d3195 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:13.860266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7bc033a3-39ad-4074-ba01-b968ff0d3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:13.963016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:14.119841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff99cc2-d6c7-4d62-a9a8-d3d31f9b4d0a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:14.121258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eff99cc2-d6c7-4d62-a9a8-d3d31f9b4d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:14.207566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:14.273631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff99cc2-d6c7-4d62-a9a8-d3d31f9b4d0a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:14.407471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61109e5-1dcf-4c40-92b3-61b20720518a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:14.407997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61109e5-1dcf-4c40-92b3-61b20720518a service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:14.408278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61109e5-1dcf-4c40-92b3-61b20720518a service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:14.408570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61109e5-1dcf-4c40-92b3-61b20720518a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:14.410199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e61109e5-1dcf-4c40-92b3-61b20720518a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:14.465591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:14.509534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61109e5-1dcf-4c40-92b3-61b20720518a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:14.511211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61109e5-1dcf-4c40-92b3-61b20720518a service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:14.531973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 711/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:15.378402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226a133-66a1-474b-b9f9-5ed540f8a6c2 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:15.378966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226a133-66a1-474b-b9f9-5ed540f8a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:15.378966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226a133-66a1-474b-b9f9-5ed540f8a6c2 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:15.380314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:15.385844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e2d2-4750-4ffa-a5a0-fa8a808d76eb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:15.386337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e2d2-4750-4ffa-a5a0-fa8a808d76eb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:15.386438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2e2d2-4750-4ffa-a5a0-fa8a808d76eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:15.463934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-15b2e2d2-4750-4ffa-a5a0-fa8a808d76eb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:15.465170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-15b2e2d2-4750-4ffa-a5a0-fa8a808d76eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:15.564440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:15.719963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226a133-66a1-474b-b9f9-5ed540f8a6c2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:15.721401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5226a133-66a1-474b-b9f9-5ed540f8a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:15.773144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:15.876326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226a133-66a1-474b-b9f9-5ed540f8a6c2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:15.991397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8feec-84a1-4f91-b5c0-69ab4959aa0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:15.991951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8feec-84a1-4f91-b5c0-69ab4959aa0e service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:15.992229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8feec-84a1-4f91-b5c0-69ab4959aa0e service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:15.992500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8feec-84a1-4f91-b5c0-69ab4959aa0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:15.994879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9ec8feec-84a1-4f91-b5c0-69ab4959aa0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:16.002430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:16.088090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8feec-84a1-4f91-b5c0-69ab4959aa0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:16.089711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8feec-84a1-4f91-b5c0-69ab4959aa0e service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:16.108682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 719/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:16.921102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fbe41-d569-4dd3-8ffc-ed10b590399e None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:16.921631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fbe41-d569-4dd3-8ffc-ed10b590399e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:16.921631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fbe41-d569-4dd3-8ffc-ed10b590399e None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:16.922953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:16.927956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae49c-dd76-4956-b425-aac9538999d0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:16.928475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae49c-dd76-4956-b425-aac9538999d0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:16.928475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ae49c-dd76-4956-b425-aac9538999d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:17.007997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c23ae49c-dd76-4956-b425-aac9538999d0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:17.009576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c23ae49c-dd76-4956-b425-aac9538999d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:17.079870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:17.110698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:17.265047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fbe41-d569-4dd3-8ffc-ed10b590399e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:17.266594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-176fbe41-d569-4dd3-8ffc-ed10b590399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:17.284955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:17.415344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fbe41-d569-4dd3-8ffc-ed10b590399e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:17.506193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:17.534658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64984e-f2c1-4653-b203-51494e2abbf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:17.535175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64984e-f2c1-4653-b203-51494e2abbf5 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:17.535453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64984e-f2c1-4653-b203-51494e2abbf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:17.535725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64984e-f2c1-4653-b203-51494e2abbf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:17.537341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2d64984e-f2c1-4653-b203-51494e2abbf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:17.637429 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64984e-f2c1-4653-b203-51494e2abbf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:17.639111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64984e-f2c1-4653-b203-51494e2abbf5 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:17.662778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 714/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:18.476138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688749-014e-42a0-b5aa-657a0d7e1c9c None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:18.476685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688749-014e-42a0-b5aa-657a0d7e1c9c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:18.476685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33688749-014e-42a0-b5aa-657a0d7e1c9c None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:18.478582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:09:18.483660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d5ac-9611-4efe-95fd-0c0f8618f841 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:18.484140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d5ac-9611-4efe-95fd-0c0f8618f841 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:18.484247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72d5ac-9611-4efe-95fd-0c0f8618f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:18.562814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ea72d5ac-9611-4efe-95fd-0c0f8618f841 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:18.564042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ea72d5ac-9611-4efe-95fd-0c0f8618f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:18.609780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:18.675663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:18.826459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33688749-014e-42a0-b5aa-657a0d7e1c9c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:18.827978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33688749-014e-42a0-b5aa-657a0d7e1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:18.984519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33688749-014e-42a0-b5aa-657a0d7e1c9c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:19.040793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:19.107038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024adb15-4092-43b6-9a4f-461977c16dd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:19.107567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024adb15-4092-43b6-9a4f-461977c16dd7 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:19.107841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024adb15-4092-43b6-9a4f-461977c16dd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:19.108106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024adb15-4092-43b6-9a4f-461977c16dd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:19.109824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-024adb15-4092-43b6-9a4f-461977c16dd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:19.213261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024adb15-4092-43b6-9a4f-461977c16dd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:19.214926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024adb15-4092-43b6-9a4f-461977c16dd7 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:19.236019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 722/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:20.078518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f97fc-2f86-4df4-a98d-8ae95387ec02 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:20.079081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f97fc-2f86-4df4-a98d-8ae95387ec02 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:20.079081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f97fc-2f86-4df4-a98d-8ae95387ec02 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:20.080413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:20.085495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962039-12e8-419b-ab16-243c63ba7a27 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:20.085926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962039-12e8-419b-ab16-243c63ba7a27 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:20.086105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3962039-12e8-419b-ab16-243c63ba7a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:20.162131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e3962039-12e8-419b-ab16-243c63ba7a27 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:20.163365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e3962039-12e8-419b-ab16-243c63ba7a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:20.165970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:20.260467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:09:20.421139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f97fc-2f86-4df4-a98d-8ae95387ec02 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:20.422703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d49f97fc-2f86-4df4-a98d-8ae95387ec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:20.575317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f97fc-2f86-4df4-a98d-8ae95387ec02 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:20.604095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:20.691730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b1993-194c-4511-b459-a8048f0322e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:20.692340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1993-194c-4511-b459-a8048f0322e7 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:20.692623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1993-194c-4511-b459-a8048f0322e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:20.692899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b1993-194c-4511-b459-a8048f0322e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:20.694553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f65b1993-194c-4511-b459-a8048f0322e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:20.787659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b1993-194c-4511-b459-a8048f0322e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:20.789294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b1993-194c-4511-b459-a8048f0322e7 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:20.809024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 717/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:22.645584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81978a-9772-4bdd-ba24-09981c7f25ef None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:22.646114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81978a-9772-4bdd-ba24-09981c7f25ef None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:22.646114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81978a-9772-4bdd-ba24-09981c7f25ef None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:22.647502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:22.653083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11399c-3117-40a4-bd72-7a52a344c9de None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:22.653488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11399c-3117-40a4-bd72-7a52a344c9de None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:22.653623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11399c-3117-40a4-bd72-7a52a344c9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:22.695382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:22.722225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-de11399c-3117-40a4-bd72-7a52a344c9de None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:22.723470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-de11399c-3117-40a4-bd72-7a52a344c9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:22.826502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:23.111211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81978a-9772-4bdd-ba24-09981c7f25ef None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:23.112793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0f81978a-9772-4bdd-ba24-09981c7f25ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:23.222777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81978a-9772-4bdd-ba24-09981c7f25ef None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:23.256066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:23.298762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d27961-a59a-4558-8505-84e0d193d2f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:23.299363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27961-a59a-4558-8505-84e0d193d2f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:23.299639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27961-a59a-4558-8505-84e0d193d2f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:23.299911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d27961-a59a-4558-8505-84e0d193d2f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:23.301503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-17d27961-a59a-4558-8505-84e0d193d2f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:23.413517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d27961-a59a-4558-8505-84e0d193d2f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:23.415416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d27961-a59a-4558-8505-84e0d193d2f0 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:23.434952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 725/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:25.539125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce1c-41a5-4321-b506-959ece3ae757 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:25.539810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce1c-41a5-4321-b506-959ece3ae757 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:25.539810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce1c-41a5-4321-b506-959ece3ae757 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:25.541087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:25.547012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588a0c-1837-4762-a623-02596d3c7809 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:25.547582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588a0c-1837-4762-a623-02596d3c7809 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:25.547582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20588a0c-1837-4762-a623-02596d3c7809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:25.621134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-20588a0c-1837-4762-a623-02596d3c7809 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:25.622381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-20588a0c-1837-4762-a623-02596d3c7809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:25.635593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:25.723840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:26.008396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ce1c-41a5-4321-b506-959ece3ae757 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:26.010223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-de60ce1c-41a5-4321-b506-959ece3ae757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:26.121197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ce1c-41a5-4321-b506-959ece3ae757 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:26.133496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:26.195638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d61598-36a1-4df7-b5d0-98b947b4e384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:26.196939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d61598-36a1-4df7-b5d0-98b947b4e384 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:26.197223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d61598-36a1-4df7-b5d0-98b947b4e384 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:26.197492 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d61598-36a1-4df7-b5d0-98b947b4e384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:26.199113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-79d61598-36a1-4df7-b5d0-98b947b4e384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:26.307959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d61598-36a1-4df7-b5d0-98b947b4e384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:26.309400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d61598-36a1-4df7-b5d0-98b947b4e384 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:26.330356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 720/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:28.633066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f290-8e18-47b4-90c8-857091b26271 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:28.634269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f290-8e18-47b4-90c8-857091b26271 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:28.634269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24f290-8e18-47b4-90c8-857091b26271 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:28.635760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:28.641712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d1ef-881a-4e35-85ac-81d2844b9003 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:28.642186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d1ef-881a-4e35-85ac-81d2844b9003 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:28.642300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0d1ef-881a-4e35-85ac-81d2844b9003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:28.691450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:28.710848 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-caa0d1ef-881a-4e35-85ac-81d2844b9003 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:28.712189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-caa0d1ef-881a-4e35-85ac-81d2844b9003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:28.816255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:29.105488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24f290-8e18-47b4-90c8-857091b26271 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:29.107052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-be24f290-8e18-47b4-90c8-857091b26271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:29.214706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24f290-8e18-47b4-90c8-857091b26271 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:29.261029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:29.295644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e28d47-1ef0-4be2-9562-5fa66e9e6f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:29.296256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28d47-1ef0-4be2-9562-5fa66e9e6f44 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:29.296529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28d47-1ef0-4be2-9562-5fa66e9e6f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:29.296806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e28d47-1ef0-4be2-9562-5fa66e9e6f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:29.298435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d3e28d47-1ef0-4be2-9562-5fa66e9e6f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:29.408432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28d47-1ef0-4be2-9562-5fa66e9e6f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:29.409897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e28d47-1ef0-4be2-9562-5fa66e9e6f44 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:29.429258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 728/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:31.537477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087728f-873b-4553-bb31-6fb19c2baf7d None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:31.538008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087728f-873b-4553-bb31-6fb19c2baf7d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:31.538008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087728f-873b-4553-bb31-6fb19c2baf7d None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:31.539414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:31.545946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08334d89-9dd7-40c7-b622-c5f851fb874d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:31.546434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08334d89-9dd7-40c7-b622-c5f851fb874d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:31.546553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08334d89-9dd7-40c7-b622-c5f851fb874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:31.617791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-08334d89-9dd7-40c7-b622-c5f851fb874d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:31.619149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-08334d89-9dd7-40c7-b622-c5f851fb874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:31.640606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:31.726546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:32.008846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087728f-873b-4553-bb31-6fb19c2baf7d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:32.010487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e087728f-873b-4553-bb31-6fb19c2baf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:32.119106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087728f-873b-4553-bb31-6fb19c2baf7d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:32.139460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:32.192877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a483081-b0b3-4d32-90da-f5fac18b4954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:32.193482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483081-b0b3-4d32-90da-f5fac18b4954 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:32.193755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483081-b0b3-4d32-90da-f5fac18b4954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:32.194020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a483081-b0b3-4d32-90da-f5fac18b4954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:32.195634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1a483081-b0b3-4d32-90da-f5fac18b4954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:32.307431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a483081-b0b3-4d32-90da-f5fac18b4954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:32.308884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a483081-b0b3-4d32-90da-f5fac18b4954 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:32.327133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 723/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:34.349518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3c00-42dd-4169-ae83-259da273fa81 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:34.350085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3c00-42dd-4169-ae83-259da273fa81 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:34.350085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3c00-42dd-4169-ae83-259da273fa81 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:34.351460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:34.357756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc358-4aa4-4687-a805-dcc5d94f46ad None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:34.358229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc358-4aa4-4687-a805-dcc5d94f46ad None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:34.358357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddc358-4aa4-4687-a805-dcc5d94f46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:34.425247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:34.428120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-03ddc358-4aa4-4687-a805-dcc5d94f46ad None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:34.430007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-03ddc358-4aa4-4687-a805-dcc5d94f46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:34.534954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:34.822799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee3c00-42dd-4169-ae83-259da273fa81 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:34.824339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-acee3c00-42dd-4169-ae83-259da273fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:34.934735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee3c00-42dd-4169-ae83-259da273fa81 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:34.985548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:35.014866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96ce48-2ff5-4ff3-8d37-46e406bf16f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:35.015475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96ce48-2ff5-4ff3-8d37-46e406bf16f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:35.015761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96ce48-2ff5-4ff3-8d37-46e406bf16f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:35.016049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96ce48-2ff5-4ff3-8d37-46e406bf16f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:35.017684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-af96ce48-2ff5-4ff3-8d37-46e406bf16f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:35.134935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96ce48-2ff5-4ff3-8d37-46e406bf16f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:35.136296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96ce48-2ff5-4ff3-8d37-46e406bf16f6 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:35.155307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 731/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:37.161510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17651a-9d02-47b6-b9fc-ef05480521fc None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:37.162159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17651a-9d02-47b6-b9fc-ef05480521fc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:37.162159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17651a-9d02-47b6-b9fc-ef05480521fc None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:37.163481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:09:37.169534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10233e29-94b0-4734-bc05-7618c04e3a26 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:37.170004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10233e29-94b0-4734-bc05-7618c04e3a26 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:37.170116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10233e29-94b0-4734-bc05-7618c04e3a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:37.236682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-10233e29-94b0-4734-bc05-7618c04e3a26 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:37.237880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-10233e29-94b0-4734-bc05-7618c04e3a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:37.268034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:37.343186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:37.642551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17651a-9d02-47b6-b9fc-ef05480521fc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:37.644127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-da17651a-9d02-47b6-b9fc-ef05480521fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:37.751476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17651a-9d02-47b6-b9fc-ef05480521fc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:37.782558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:37.831096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a63aa-6f7b-43f5-b9c9-1c4ae26a482a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:37.831694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a63aa-6f7b-43f5-b9c9-1c4ae26a482a service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:37.831979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a63aa-6f7b-43f5-b9c9-1c4ae26a482a service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:37.832253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a63aa-6f7b-43f5-b9c9-1c4ae26a482a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:37.833876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f37a63aa-6f7b-43f5-b9c9-1c4ae26a482a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:37.955337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a63aa-6f7b-43f5-b9c9-1c4ae26a482a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:37.956745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a63aa-6f7b-43f5-b9c9-1c4ae26a482a service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:37.976378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 726/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:39.995634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664e179-e9af-4fce-a031-70eaa086dfd6 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:39.996210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664e179-e9af-4fce-a031-70eaa086dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:39.996210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664e179-e9af-4fce-a031-70eaa086dfd6 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:39.997571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:09:40.002917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26358a25-6948-43b6-83db-b45174cf368f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:40.003370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26358a25-6948-43b6-83db-b45174cf368f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:40.003474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26358a25-6948-43b6-83db-b45174cf368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:40.071867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-26358a25-6948-43b6-83db-b45174cf368f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:40.073004 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-26358a25-6948-43b6-83db-b45174cf368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:40.081629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:40.174171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:40.458779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664e179-e9af-4fce-a031-70eaa086dfd6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:40.460365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8664e179-e9af-4fce-a031-70eaa086dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:40.568706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664e179-e9af-4fce-a031-70eaa086dfd6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:40.628610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:40.648440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f91fb-25d2-40bf-a27c-a146616b27bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:40.649045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f91fb-25d2-40bf-a27c-a146616b27bf service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:40.649321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f91fb-25d2-40bf-a27c-a146616b27bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:40.650187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f91fb-25d2-40bf-a27c-a146616b27bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:40.651839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f99f91fb-25d2-40bf-a27c-a146616b27bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:40.768475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f91fb-25d2-40bf-a27c-a146616b27bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:40.770430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f91fb-25d2-40bf-a27c-a146616b27bf service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:40.793181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 734/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:09:42.830316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e32cd-18e5-4cd5-b624-839dd7ed3ca3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:42.830872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e32cd-18e5-4cd5-b624-839dd7ed3ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:42.830872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e32cd-18e5-4cd5-b624-839dd7ed3ca3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:42.832205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:42.838204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5c0d-7939-4c99-87d2-e70562b261aa None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:42.838686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5c0d-7939-4c99-87d2-e70562b261aa None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:42.838960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5c0d-7939-4c99-87d2-e70562b261aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:42.915007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-34da5c0d-7939-4c99-87d2-e70562b261aa None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:42.917531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34da5c0d-7939-4c99-87d2-e70562b261aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:42.972610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:43.034481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:43.317355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e32cd-18e5-4cd5-b624-839dd7ed3ca3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:43.318929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b41e32cd-18e5-4cd5-b624-839dd7ed3ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:43.433201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e32cd-18e5-4cd5-b624-839dd7ed3ca3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:43.479897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:43.519329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9900df-0fda-43ea-80f3-22521cdfb08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:43.519945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9900df-0fda-43ea-80f3-22521cdfb08f service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:43.520224 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9900df-0fda-43ea-80f3-22521cdfb08f service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:43.520497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9900df-0fda-43ea-80f3-22521cdfb08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:43.522121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fc9900df-0fda-43ea-80f3-22521cdfb08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:43.636209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9900df-0fda-43ea-80f3-22521cdfb08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:43.637649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9900df-0fda-43ea-80f3-22521cdfb08f service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:43.656892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 729/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:45.638444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b2ea0-55cf-40d1-bdf4-0988d37f5c11 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:45.639009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b2ea0-55cf-40d1-bdf4-0988d37f5c11 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:45.639009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b2ea0-55cf-40d1-bdf4-0988d37f5c11 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:45.640380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:45.645841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee523117-5089-4db9-b3c9-a2ad45550934 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:45.646329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee523117-5089-4db9-b3c9-a2ad45550934 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:45.646436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee523117-5089-4db9-b3c9-a2ad45550934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:45.732457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ee523117-5089-4db9-b3c9-a2ad45550934 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:45.733585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ee523117-5089-4db9-b3c9-a2ad45550934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:45.752195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:45.835314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:46.135023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b2ea0-55cf-40d1-bdf4-0988d37f5c11 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:46.136715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f86b2ea0-55cf-40d1-bdf4-0988d37f5c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:46.241371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b2ea0-55cf-40d1-bdf4-0988d37f5c11 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:46.310316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:46.317795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f3e7c-63d3-47cb-9a1d-0d7aa5ce2cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:46.318435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3e7c-63d3-47cb-9a1d-0d7aa5ce2cdd service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:46.318717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3e7c-63d3-47cb-9a1d-0d7aa5ce2cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:46.318989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3e7c-63d3-47cb-9a1d-0d7aa5ce2cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:46.320604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bc0f3e7c-63d3-47cb-9a1d-0d7aa5ce2cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:46.438723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f3e7c-63d3-47cb-9a1d-0d7aa5ce2cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:46.440084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f3e7c-63d3-47cb-9a1d-0d7aa5ce2cdd service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:46.459017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 737/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:48.445800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3624a-e2bf-43fb-967c-ef853df45a0a None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:48.446417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3624a-e2bf-43fb-967c-ef853df45a0a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:48.446417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3624a-e2bf-43fb-967c-ef853df45a0a None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:48.448608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:09:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:09:48.454121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79be18-fd1f-4178-afb5-db8987caeb37 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:48.454587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79be18-fd1f-4178-afb5-db8987caeb37 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:48.454706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79be18-fd1f-4178-afb5-db8987caeb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:48.524623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ea79be18-fd1f-4178-afb5-db8987caeb37 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:09:48.526457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ea79be18-fd1f-4178-afb5-db8987caeb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:48.575609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:48.629642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:09:48.918741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3624a-e2bf-43fb-967c-ef853df45a0a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:09:48.920286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bfd3624a-e2bf-43fb-967c-ef853df45a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:49.037141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3624a-e2bf-43fb-967c-ef853df45a0a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:09:49.089109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:49.116938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a90f88-4401-40f2-be93-24973aeb37b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:09:49.117538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90f88-4401-40f2-be93-24973aeb37b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:09:49.117820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90f88-4401-40f2-be93-24973aeb37b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:09:49.118095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a90f88-4401-40f2-be93-24973aeb37b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:09:49.120399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b4a90f88-4401-40f2-be93-24973aeb37b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:09:49.237743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90f88-4401-40f2-be93-24973aeb37b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:09:49.239130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a90f88-4401-40f2-be93-24973aeb37b3 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:09:49.258358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 732/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:09:58.627770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=22 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:09:59.255875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=66 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:09.136733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8787e-89fc-448c-8f9d-133b78f6ffad None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:09.137351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8787e-89fc-448c-8f9d-133b78f6ffad None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:09.137351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8787e-89fc-448c-8f9d-133b78f6ffad None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:09.138678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 739/1471] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:09.144027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cce5-87b9-4b0b-a5eb-78bb23f4d9e6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:09.144501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cce5-87b9-4b0b-a5eb-78bb23f4d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:09.144606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60cce5-87b9-4b0b-a5eb-78bb23f4d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:09.220008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fa60cce5-87b9-4b0b-a5eb-78bb23f4d9e6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:09.221256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fa60cce5-87b9-4b0b-a5eb-78bb23f4d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:09.327632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 733/1472] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:09.642632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0202-d772-48f2-9513-b7953b5b87dd None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:09.642919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0202-d772-48f2-9513-b7953b5b87dd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:09.643198 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0202-d772-48f2-9513-b7953b5b87dd None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:09.645678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 740/1473] 10.222.0.36 () {54 vars in 967 bytes} [Thu Sep 1 08:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:09.651101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc4ae-bb7d-4546-9a6f-ac70f320227a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:09.651450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc4ae-bb7d-4546-9a6f-ac70f320227a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:09.651670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc4ae-bb7d-4546-9a6f-ac70f320227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:09.743866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5fbcc4ae-bb7d-4546-9a6f-ac70f320227a None None] MFA Rules not processed for user `916a9bae3ca94918af4efdfcae19d928`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:09.748751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5fbcc4ae-bb7d-4546-9a6f-ac70f320227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:09.777188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:09.847049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 734/1474] 10.222.0.36 () {58 vars in 1064 bytes} [Thu Sep 1 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:09.856086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec0202-d772-48f2-9513-b7953b5b87dd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:09.857722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b5ec0202-d772-48f2-9513-b7953b5b87dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:09.972195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec0202-d772-48f2-9513-b7953b5b87dd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:10.052640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9540a-bca3-48cd-afa0-a351a7a6ea86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '916a9bae3ca94918af4efdfcae19d928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:10.053254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9540a-bca3-48cd-afa0-a351a7a6ea86 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:10.053538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9540a-bca3-48cd-afa0-a351a7a6ea86 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:10.053814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9540a-bca3-48cd-afa0-a351a7a6ea86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:10.055477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-52b9540a-bca3-48cd-afa0-a351a7a6ea86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:10.112114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:10.172780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9540a-bca3-48cd-afa0-a351a7a6ea86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:10.174324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9540a-bca3-48cd-afa0-a351a7a6ea86 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:10.194296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 741/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:12.297978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9190f3-031a-4e3c-823c-68db912ceef8 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:12.298576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9190f3-031a-4e3c-823c-68db912ceef8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:12.298576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9190f3-031a-4e3c-823c-68db912ceef8 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:12.299887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 735/1476] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:12.305314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e301d6c-6d6b-4a6c-b338-17baf7f01fc4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:12.305711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e301d6c-6d6b-4a6c-b338-17baf7f01fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:12.305868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e301d6c-6d6b-4a6c-b338-17baf7f01fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:12.375384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0e301d6c-6d6b-4a6c-b338-17baf7f01fc4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:12.376608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0e301d6c-6d6b-4a6c-b338-17baf7f01fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:12.476363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 742/1477] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:12.756651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9190f3-031a-4e3c-823c-68db912ceef8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:12.758184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b9190f3-031a-4e3c-823c-68db912ceef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:12.886797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9190f3-031a-4e3c-823c-68db912ceef8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:12.940095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:12.989186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b22f8-bc73-4a36-9af8-4cb5cc9177aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:12.989789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b22f8-bc73-4a36-9af8-4cb5cc9177aa admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:12.990060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b22f8-bc73-4a36-9af8-4cb5cc9177aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:12.990357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b22f8-bc73-4a36-9af8-4cb5cc9177aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:12.990990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b22f8-bc73-4a36-9af8-4cb5cc9177aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:12.992814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-2d9b22f8-bc73-4a36-9af8-4cb5cc9177aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:10:12.992814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:10:12.992814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:10:12.994059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b22f8-bc73-4a36-9af8-4cb5cc9177aa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:13.014846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 736/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Sep 1 08:10:12 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:10:14.967566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530a56-6a2d-480b-920e-fd95b6899ef4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:14.968093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530a56-6a2d-480b-920e-fd95b6899ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:14.968093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e530a56-6a2d-480b-920e-fd95b6899ef4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:14.969407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 743/1479] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:14.974827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265eac2-7f44-46e8-98b9-92c5ef6f628e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:14.975240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265eac2-7f44-46e8-98b9-92c5ef6f628e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:14.975374 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265eac2-7f44-46e8-98b9-92c5ef6f628e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:15.044527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b265eac2-7f44-46e8-98b9-92c5ef6f628e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:15.045742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b265eac2-7f44-46e8-98b9-92c5ef6f628e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:15.142878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 737/1480] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:15.451624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e530a56-6a2d-480b-920e-fd95b6899ef4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:15.453190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9e530a56-6a2d-480b-920e-fd95b6899ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:15.466386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:15.611472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e530a56-6a2d-480b-920e-fd95b6899ef4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:15.694397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:15.728695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3cd50-c4a8-4d3c-a864-9a2be684655d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:15.729298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cd50-c4a8-4d3c-a864-9a2be684655d service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:15.729834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cd50-c4a8-4d3c-a864-9a2be684655d service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:15.730100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cd50-c4a8-4d3c-a864-9a2be684655d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:15.731735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-49e3cd50-c4a8-4d3c-a864-9a2be684655d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:15.821967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3cd50-c4a8-4d3c-a864-9a2be684655d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:15.824346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3cd50-c4a8-4d3c-a864-9a2be684655d service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:15.843151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 744/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:18.032252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5df6f-bce5-46b4-9255-d8b5c1aea6e1 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:18.032793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5df6f-bce5-46b4-9255-d8b5c1aea6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:18.032793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5df6f-bce5-46b4-9255-d8b5c1aea6e1 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:18.034153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 738/1482] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:18.039747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261ea6-1010-4315-94ea-2e5df4824321 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:18.040216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261ea6-1010-4315-94ea-2e5df4824321 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:18.040311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0261ea6-1010-4315-94ea-2e5df4824321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:18.111225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e0261ea6-1010-4315-94ea-2e5df4824321 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:18.112450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e0261ea6-1010-4315-94ea-2e5df4824321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:18.161330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:18.214473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 745/1483] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:18.503054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5df6f-bce5-46b4-9255-d8b5c1aea6e1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:18.504618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7dc5df6f-bce5-46b4-9255-d8b5c1aea6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:18.529199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:18.612777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5df6f-bce5-46b4-9255-d8b5c1aea6e1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:18.685792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ccd04-8f25-45fc-b9ba-85f500db6343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:18.686421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ccd04-8f25-45fc-b9ba-85f500db6343 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:18.686698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ccd04-8f25-45fc-b9ba-85f500db6343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:18.686966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ccd04-8f25-45fc-b9ba-85f500db6343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:18.688556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f01ccd04-8f25-45fc-b9ba-85f500db6343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:18.765164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:18.803331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ccd04-8f25-45fc-b9ba-85f500db6343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:18.804796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ccd04-8f25-45fc-b9ba-85f500db6343 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:18.823419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 739/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:20.835870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a866f-b8b1-4186-8943-41fcce6b2b95 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:20.836462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a866f-b8b1-4186-8943-41fcce6b2b95 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:20.836462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a866f-b8b1-4186-8943-41fcce6b2b95 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:20.838412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 746/1485] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:20.844653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b56c-98fc-4e40-94ce-7061446736bc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:20.845191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b56c-98fc-4e40-94ce-7061446736bc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:20.845191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b56c-98fc-4e40-94ce-7061446736bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:20.917032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c306b56c-98fc-4e40-94ce-7061446736bc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:20.918555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c306b56c-98fc-4e40-94ce-7061446736bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:21.019068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 740/1486] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:21.312099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a866f-b8b1-4186-8943-41fcce6b2b95 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:21.313648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-654a866f-b8b1-4186-8943-41fcce6b2b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:21.418345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a866f-b8b1-4186-8943-41fcce6b2b95 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:21.504182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:21.506401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3074-1d81-4252-86cd-8592f517baf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:21.507098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3074-1d81-4252-86cd-8592f517baf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:21.507410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3074-1d81-4252-86cd-8592f517baf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:21.507694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3074-1d81-4252-86cd-8592f517baf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:21.510470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ad1d3074-1d81-4252-86cd-8592f517baf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:21.632689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3074-1d81-4252-86cd-8592f517baf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:21.634131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3074-1d81-4252-86cd-8592f517baf2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:21.652735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 747/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:23.702937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a1df6-e864-4d63-a3b8-91fd66a5fb29 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:23.703460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a1df6-e864-4d63-a3b8-91fd66a5fb29 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:23.703460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a1df6-e864-4d63-a3b8-91fd66a5fb29 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:23.704740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 741/1488] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:23.710197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f1fa6-dcc4-4dc6-ba1e-42b6d4d035be None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:23.710676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f1fa6-dcc4-4dc6-ba1e-42b6d4d035be None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:23.710795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f1fa6-dcc4-4dc6-ba1e-42b6d4d035be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:23.779484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-350f1fa6-dcc4-4dc6-ba1e-42b6d4d035be None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:23.780732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-350f1fa6-dcc4-4dc6-ba1e-42b6d4d035be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:23.834687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:23.881079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 748/1489] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:24.173690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a1df6-e864-4d63-a3b8-91fd66a5fb29 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:24.175262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bd8a1df6-e864-4d63-a3b8-91fd66a5fb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:24.216884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:24.292393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a1df6-e864-4d63-a3b8-91fd66a5fb29 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:24.370279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f0960-0788-422c-9dcb-85a2a0cb2f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:24.370896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0960-0788-422c-9dcb-85a2a0cb2f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:24.371169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0960-0788-422c-9dcb-85a2a0cb2f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:24.371436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f0960-0788-422c-9dcb-85a2a0cb2f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:24.373051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fd3f0960-0788-422c-9dcb-85a2a0cb2f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:24.578337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:24.610882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0960-0788-422c-9dcb-85a2a0cb2f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:24.612316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f0960-0788-422c-9dcb-85a2a0cb2f95 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:24.630282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 742/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:26.845983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22156-b993-4f7c-8297-f90b3c61b9f3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:26.846521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22156-b993-4f7c-8297-f90b3c61b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:26.846521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a22156-b993-4f7c-8297-f90b3c61b9f3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:26.847863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 749/1491] 10.222.0.36 () {54 vars in 927 bytes} [Thu Sep 1 08:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:10:26.853523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0cb45-7a4c-4bd0-9f4c-89a1067f23ba None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:26.854200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0cb45-7a4c-4bd0-9f4c-89a1067f23ba None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:26.854412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0cb45-7a4c-4bd0-9f4c-89a1067f23ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:26.926141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a5e0cb45-7a4c-4bd0-9f4c-89a1067f23ba None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:10:26.927427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a5e0cb45-7a4c-4bd0-9f4c-89a1067f23ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:27.035045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 743/1492] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Sep 1 08:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:10:27.330443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22156-b993-4f7c-8297-f90b3c61b9f3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:10:27.331990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c5a22156-b993-4f7c-8297-f90b3c61b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:27.436125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a22156-b993-4f7c-8297-f90b3c61b9f3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:10:27.512289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b162f5d-deb1-4ddc-86fc-9a7e880d7ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:10:27.512895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b162f5d-deb1-4ddc-86fc-9a7e880d7ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:10:27.513175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b162f5d-deb1-4ddc-86fc-9a7e880d7ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:10:27.513447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b162f5d-deb1-4ddc-86fc-9a7e880d7ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:10:27.515151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6b162f5d-deb1-4ddc-86fc-9a7e880d7ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:10:27.524225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:27.636439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b162f5d-deb1-4ddc-86fc-9a7e880d7ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:10:27.638592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b162f5d-deb1-4ddc-86fc-9a7e880d7ae9 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:10:27.657568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 750/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:10:37.032588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=82 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:10:37.655096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=50 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:48.791368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:48.791985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:48.791985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:48.873075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:11:48.874822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:48.973749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 744/1494] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:11:48.982994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5fbcc-fed6-4acb-8aac-6334cda6a949 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:48.983532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5fbcc-fed6-4acb-8aac-6334cda6a949 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:48.983532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5fbcc-fed6-4acb-8aac-6334cda6a949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:49.072477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4fe5fbcc-fed6-4acb-8aac-6334cda6a949 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:11:49.074088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4fe5fbcc-fed6-4acb-8aac-6334cda6a949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:49.176254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 751/1495] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:11:49.181165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:49.182421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:49.195018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdac672-3785-40f4-80ee-5b9fe056b60d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:49.258422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:49.293214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:49.293818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:49.294096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:49.294400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:49.295051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:11:49.295352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:49.296367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:49.296367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:11:49.296367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:11:49.297266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:49.309580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 745/1496] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:11:49.318628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5fbcc-fed6-4acb-8aac-6334cda6a949 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:49.328226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5fbcc-fed6-4acb-8aac-6334cda6a949 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:49.400798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:49.441568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:49.441568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:49.441568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:49.441568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:49.442048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:49.442048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:49.442048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 01 08:11:49.442048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: Sep 01 08:11:49.442408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:49.505165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 752/1497] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:11:49 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:11:49.509594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:49.511222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:49.546228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26a266-fef4-4e3b-8fd0-bdd6215badca admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:49.643030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:49.643638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:49.643916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:49.644186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:49.644823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:49.645826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:49.645826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:11:49.645826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:11:49.647069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:49.690490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 746/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:11:49 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:11:49.695337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:49.697009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:49.764147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73ebd-0b7a-4f98-aca8-a962365f82f7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:49.852142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:49.864280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:49.864890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:49.865171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:49.865443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:49.866084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:49.867134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:49.867134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 01 08:11:49.867134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: Sep 01 08:11:49.868058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:49.880831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 753/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:11:49.884917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:49.887002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:49.898334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a76e82-04fd-46de-a1c8-92a4ce674beb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:49.924229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:50.007321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7c0bd-2e10-4091-9c2c-ef69d10021a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:50.007933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c0bd-2e10-4091-9c2c-ef69d10021a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:50.008219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c0bd-2e10-4091-9c2c-ef69d10021a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:50.008573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c0bd-2e10-4091-9c2c-ef69d10021a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:50.009334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7c0bd-2e10-4091-9c2c-ef69d10021a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:50.010404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-dee7c0bd-2e10-4091-9c2c-ef69d10021a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:50.010404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:11:50.010404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:11:50.011910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7c0bd-2e10-4091-9c2c-ef69d10021a2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:50.024520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 747/1500] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:11:50.029510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:50.031097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:50.065801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0840a-81e8-4783-9c19-69e417501207 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:50.169694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fa8b5-cf8c-4daf-b6e4-88007e131d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:50.170384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fa8b5-cf8c-4daf-b6e4-88007e131d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:50.170664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fa8b5-cf8c-4daf-b6e4-88007e131d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:50.170934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fa8b5-cf8c-4daf-b6e4-88007e131d4b admin admin] PATH_INFO: `/v3/projects/78a72daa03644b04b752fb290880a374/users/657e9c7a309341f0b4e671148f671d89/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:50.192441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fa8b5-cf8c-4daf-b6e4-88007e131d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a72daa03644b04b752fb290880a374, user_id=657e9c7a309341f0b4e671148f671d89, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:50.193475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-323fa8b5-cf8c-4daf-b6e4-88007e131d4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:50.193475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 01 08:11:50.193475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: Sep 01 08:11:50.195472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fa8b5-cf8c-4daf-b6e4-88007e131d4b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:50.221434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 754/1501] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:11:50 2022] PUT /identity/v3/projects/78a72daa03644b04b752fb290880a374/users/657e9c7a309341f0b4e671148f671d89/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:11:50.234504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bc52-4930-479c-aae6-621d8b721788 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:50.234835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bc52-4930-479c-aae6-621d8b721788 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:50.235174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722bc52-4930-479c-aae6-621d8b721788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:50.292618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b722bc52-4930-479c-aae6-621d8b721788 None None] MFA Rules not processed for user `657e9c7a309341f0b4e671148f671d89`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:11:50.293945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b722bc52-4930-479c-aae6-621d8b721788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:50.375279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 748/1502] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:11:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:11:50.388810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a4e6-4ccd-47d4-b3b2-013ea7769337 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:50.389096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a4e6-4ccd-47d4-b3b2-013ea7769337 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:50.389370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09a4e6-4ccd-47d4-b3b2-013ea7769337 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:50.390771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 755/1503] 10.222.0.36 () {54 vars in 964 bytes} [Thu Sep 1 08:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:11:50.395824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecd86-4270-48d3-8681-fc650c3b0c7f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:50.396110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecd86-4270-48d3-8681-fc650c3b0c7f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:50.396387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecd86-4270-48d3-8681-fc650c3b0c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:50.428606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:50.475791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-aa4ecd86-4270-48d3-8681-fc650c3b0c7f None None] MFA Rules not processed for user `146b6b09371b4deb940ad1fb924ea984`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:11:50.477018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aa4ecd86-4270-48d3-8681-fc650c3b0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:50.556472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 749/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Sep 1 08:11:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:11:50.565277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09a4e6-4ccd-47d4-b3b2-013ea7769337 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:50.566894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3b09a4e6-4ccd-47d4-b3b2-013ea7769337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:50.619829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:50.675521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09a4e6-4ccd-47d4-b3b2-013ea7769337 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:50.748089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:50.748692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:50.748965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:50.749233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:50.750836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:50.851222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:50.852578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:50.856214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:50.872280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 756/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:11:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:11:50.917401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c278c-112f-4279-8d7e-202c7c7185ee None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:50.917814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c278c-112f-4279-8d7e-202c7c7185ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:50.918127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c278c-112f-4279-8d7e-202c7c7185ee None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:50.919412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 750/1506] 10.222.0.36 () {52 vars in 830 bytes} [Thu Sep 1 08:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:11:50.923055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:50.924298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:51.027208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51890cb4-8921-4c83-9f79-51d4ef09453a service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:51.125664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:51.126361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:51.126512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:51.126786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] PATH_INFO: `/v3/users/657e9c7a309341f0b4e671148f671d89` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:51.141833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657e9c7a309341f0b4e671148f671d89)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:51.143025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:51.143025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 01 08:11:51.143025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: Sep 01 08:11:51.144586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:51.155460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:51.214315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657e9c7a309341f0b4e671148f671d89'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:51.238093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657e9c7a309341f0b4e671148f671d89'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:51.252599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657e9c7a309341f0b4e671148f671d89'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:51.253191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657e9c7a309341f0b4e671148f671d89'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:51.262518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657e9c7a309341f0b4e671148f671d89'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:51.268335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 757/1507] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:11:50 2022] DELETE /identity/v3/users/657e9c7a309341f0b4e671148f671d89 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:11:51.272904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:51.273210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:51.273508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:51.331165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:11:51.332363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:51.410518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:51.424149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 751/1508] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:11:51.434615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:51.435875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:51.540276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f98400-4d38-418d-a940-076f93a72c21 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:51.595512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:11:51.618082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ac246-fa06-4195-a794-45846b3b0474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:51.618732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ac246-fa06-4195-a794-45846b3b0474 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:51.619062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ac246-fa06-4195-a794-45846b3b0474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:51.619281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ac246-fa06-4195-a794-45846b3b0474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:51.621034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6b6ac246-fa06-4195-a794-45846b3b0474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:51.735434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ac246-fa06-4195-a794-45846b3b0474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:51.736886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ac246-fa06-4195-a794-45846b3b0474 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:51.879350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 758/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:11:52.207534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:11:52.208783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:11:52.220167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a753c-c9e5-4065-9159-4562093f9d14 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:11:52.316908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:11:52.317535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:11:52.317824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:11:52.318076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] PATH_INFO: `/v3/projects/78a72daa03644b04b752fb290880a374` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:11:52.328794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a72daa03644b04b752fb290880a374)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:11:52.329807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:11:52.329807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:11:52.329807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:11:52.331045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:11:52.389862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a72daa03644b04b752fb290880a374', 'request_id': 'req-87fe06da-cde3-4765-a82e-dcc683b34af3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:52.398889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a72daa03644b04b752fb290880a374', 'request_id': 'req-87fe06da-cde3-4765-a82e-dcc683b34af3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:52.412460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a72daa03644b04b752fb290880a374', 'request_id': 'req-87fe06da-cde3-4765-a82e-dcc683b34af3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:52.435721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] The token cache is being invalidate because project 78a72daa03644b04b752fb290880a374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:11:52.436006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:52.436529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-87fe06da-cde3-4765-a82e-dcc683b34af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:11:52.437840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 752/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:11:52 2022] DELETE /identity/v3/projects/78a72daa03644b04b752fb290880a374 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:12:01.876727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=62 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:12:02.433832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:26.598272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc11e0-3566-4fa3-99ea-b5f2fd17c798 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:26.598747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc11e0-3566-4fa3-99ea-b5f2fd17c798 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:26.598858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc11e0-3566-4fa3-99ea-b5f2fd17c798 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:26.600158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:26.605039 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac70b-5cd3-4835-a213-eb28019f7593 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:26.605476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac70b-5cd3-4835-a213-eb28019f7593 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:26.605580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac70b-5cd3-4835-a213-eb28019f7593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:26.690155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9abac70b-5cd3-4835-a213-eb28019f7593 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:26.691410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9abac70b-5cd3-4835-a213-eb28019f7593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:26.795807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:26.951020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc11e0-3566-4fa3-99ea-b5f2fd17c798 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:26.953988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-09bc11e0-3566-4fa3-99ea-b5f2fd17c798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:27.079849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc11e0-3566-4fa3-99ea-b5f2fd17c798 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:27.085262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee037e-b500-460d-927b-14eb1f291cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:27.085866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee037e-b500-460d-927b-14eb1f291cc8 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:27.086142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee037e-b500-460d-927b-14eb1f291cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:27.086438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee037e-b500-460d-927b-14eb1f291cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:27.094460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee037e-b500-460d-927b-14eb1f291cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:27.096045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee037e-b500-460d-927b-14eb1f291cc8 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:27.105129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 760/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:27.951198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40de6e-daee-4882-b27c-cc47339d6b94 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:27.951728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40de6e-daee-4882-b27c-cc47339d6b94 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:27.951728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40de6e-daee-4882-b27c-cc47339d6b94 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:27.953588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:27.958536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8f2e-0509-40f6-a885-528fccdd412a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:27.958961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8f2e-0509-40f6-a885-528fccdd412a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:27.959104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8f2e-0509-40f6-a885-528fccdd412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:27.978194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1a8b8f2e-0509-40f6-a885-528fccdd412a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:27.979446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a8b8f2e-0509-40f6-a885-528fccdd412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:27.987837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:28.141907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40de6e-daee-4882-b27c-cc47339d6b94 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:28.158275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40de6e-daee-4882-b27c-cc47339d6b94 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:28.163954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ac03e-a311-4820-a8b0-bac3c8603abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:28.164562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ac03e-a311-4820-a8b0-bac3c8603abc service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:28.164843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ac03e-a311-4820-a8b0-bac3c8603abc service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:28.165115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ac03e-a311-4820-a8b0-bac3c8603abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:28.174661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ac03e-a311-4820-a8b0-bac3c8603abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:28.176255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ac03e-a311-4820-a8b0-bac3c8603abc service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:28.186767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 755/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:28.211294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b9160-0d5c-4d4c-ac21-3b3c7e832770 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:28.211540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b9160-0d5c-4d4c-ac21-3b3c7e832770 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:28.211796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b9160-0d5c-4d4c-ac21-3b3c7e832770 None None] PATH_INFO: `/v3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:28.213081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 762/1517] 10.222.0.20 () {54 vars in 925 bytes} [Thu Sep 1 08:13:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:13:28.219997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcee85-b987-4319-87e5-a740f9ec87f1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:28.220301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcee85-b987-4319-87e5-a740f9ec87f1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:28.220653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcee85-b987-4319-87e5-a740f9ec87f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:28.288109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-affcee85-b987-4319-87e5-a740f9ec87f1 None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:28.289324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-affcee85-b987-4319-87e5-a740f9ec87f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:28.306809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:28.365385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 756/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Sep 1 08:13:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:37.084856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9658bb-bd7a-40b5-b30a-158d2ecb6178 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:37.085480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9658bb-bd7a-40b5-b30a-158d2ecb6178 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:37.085480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9658bb-bd7a-40b5-b30a-158d2ecb6178 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:37.086771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 763/1519] 10.222.0.36 () {54 vars in 961 bytes} [Thu Sep 1 08:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:37.091812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1e33-30bb-4141-a80c-a650c0469462 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:37.092200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1e33-30bb-4141-a80c-a650c0469462 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:37.092392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc1e33-30bb-4141-a80c-a650c0469462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:37.115050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cefc1e33-30bb-4141-a80c-a650c0469462 None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:37.116258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cefc1e33-30bb-4141-a80c-a650c0469462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:37.125576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 757/1520] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Sep 1 08:13:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:13:37.133309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9658bb-bd7a-40b5-b30a-158d2ecb6178 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:37.147177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9658bb-bd7a-40b5-b30a-158d2ecb6178 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:37.152086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7fc52-13e9-4e4d-88d8-07eaf1971754 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:37.152670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7fc52-13e9-4e4d-88d8-07eaf1971754 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:37.152990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7fc52-13e9-4e4d-88d8-07eaf1971754 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:37.153219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7fc52-13e9-4e4d-88d8-07eaf1971754 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:37.161699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7fc52-13e9-4e4d-88d8-07eaf1971754 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:37.163316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7fc52-13e9-4e4d-88d8-07eaf1971754 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:37.173557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 764/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:39.447379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5528-cf1d-4f56-ab4a-3ab25a9340c3 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:39.447929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5528-cf1d-4f56-ab4a-3ab25a9340c3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:39.447929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5528-cf1d-4f56-ab4a-3ab25a9340c3 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:39.449268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:39.454178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1552-e5b3-464f-8e9d-4c18dee0082c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:39.454666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1552-e5b3-464f-8e9d-4c18dee0082c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:39.454772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1552-e5b3-464f-8e9d-4c18dee0082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:39.474608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-beea1552-e5b3-464f-8e9d-4c18dee0082c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:39.475833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-beea1552-e5b3-464f-8e9d-4c18dee0082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:39.484532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:39.644742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5528-cf1d-4f56-ab4a-3ab25a9340c3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:39.659246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5528-cf1d-4f56-ab4a-3ab25a9340c3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:39.664673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e060a-6a50-4259-b4f1-e26f903d56b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:39.665258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e060a-6a50-4259-b4f1-e26f903d56b2 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:39.665537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e060a-6a50-4259-b4f1-e26f903d56b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:39.665808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e060a-6a50-4259-b4f1-e26f903d56b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:39.674727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e060a-6a50-4259-b4f1-e26f903d56b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:39.676296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e060a-6a50-4259-b4f1-e26f903d56b2 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:39.685533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 759/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:40.513469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb04d-9ff9-4854-901a-3a3b5a5300e3 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:40.514048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb04d-9ff9-4854-901a-3a3b5a5300e3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:40.514048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfb04d-9ff9-4854-901a-3a3b5a5300e3 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:40.516090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 08:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:40.521108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0f70c-666a-46b1-b5e7-3903f86beb4c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:40.521520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0f70c-666a-46b1-b5e7-3903f86beb4c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:40.521674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0f70c-666a-46b1-b5e7-3903f86beb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:40.541598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2ed0f70c-666a-46b1-b5e7-3903f86beb4c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:40.542810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2ed0f70c-666a-46b1-b5e7-3903f86beb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:40.550796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 08:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:40.702772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb04d-9ff9-4854-901a-3a3b5a5300e3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:40.717349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfb04d-9ff9-4854-901a-3a3b5a5300e3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:40.722631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501a3f8-bacb-43a6-b20f-8326031ab395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:40.723212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a3f8-bacb-43a6-b20f-8326031ab395 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:40.723486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a3f8-bacb-43a6-b20f-8326031ab395 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:40.723754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501a3f8-bacb-43a6-b20f-8326031ab395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:40.731696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a3f8-bacb-43a6-b20f-8326031ab395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:40.733522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501a3f8-bacb-43a6-b20f-8326031ab395 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:40.742838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 767/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:45.286411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156c6f-d360-423e-8eee-c83b0408b273 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:45.286996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156c6f-d360-423e-8eee-c83b0408b273 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:45.286996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6156c6f-d360-423e-8eee-c83b0408b273 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:45.288305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:45.293483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f2cd-02b0-459d-8405-78dd1780d53e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:45.293914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f2cd-02b0-459d-8405-78dd1780d53e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:45.294017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61f2cd-02b0-459d-8405-78dd1780d53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:45.313750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2e61f2cd-02b0-459d-8405-78dd1780d53e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:45.314972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e61f2cd-02b0-459d-8405-78dd1780d53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:45.322748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:45.619137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156c6f-d360-423e-8eee-c83b0408b273 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:45.620968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b6156c6f-d360-423e-8eee-c83b0408b273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:45.698940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6156c6f-d360-423e-8eee-c83b0408b273 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:45.703442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc2eba-60e5-4b7f-9bf5-4313bd2aba58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:45.704078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2eba-60e5-4b7f-9bf5-4313bd2aba58 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:45.704356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2eba-60e5-4b7f-9bf5-4313bd2aba58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:45.704626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc2eba-60e5-4b7f-9bf5-4313bd2aba58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:45.713437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc2eba-60e5-4b7f-9bf5-4313bd2aba58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:45.714885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc2eba-60e5-4b7f-9bf5-4313bd2aba58 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:45.724222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 762/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:47.678324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af4f2-a49d-418a-b9f7-bbc73cba24f4 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:47.678918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af4f2-a49d-418a-b9f7-bbc73cba24f4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:47.678918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894af4f2-a49d-418a-b9f7-bbc73cba24f4 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:47.680246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:47.685301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837cf0d-22c4-4cb4-b525-ed966687e843 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:47.685696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837cf0d-22c4-4cb4-b525-ed966687e843 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:47.685857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837cf0d-22c4-4cb4-b525-ed966687e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:47.705617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5837cf0d-22c4-4cb4-b525-ed966687e843 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:47.706834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5837cf0d-22c4-4cb4-b525-ed966687e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:47.714496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:48.008250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894af4f2-a49d-418a-b9f7-bbc73cba24f4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:48.019706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894af4f2-a49d-418a-b9f7-bbc73cba24f4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:48.023264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eb453-e784-43c5-9946-7a32951e56e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:48.023862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb453-e784-43c5-9946-7a32951e56e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:48.024145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb453-e784-43c5-9946-7a32951e56e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:48.024419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eb453-e784-43c5-9946-7a32951e56e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:48.037299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eb453-e784-43c5-9946-7a32951e56e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:48.038818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eb453-e784-43c5-9946-7a32951e56e7 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:48.048726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 770/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:51.447084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d14a7-2bde-4b55-b5d1-292536781b7b None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:51.447658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d14a7-2bde-4b55-b5d1-292536781b7b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:51.447658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d14a7-2bde-4b55-b5d1-292536781b7b None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:51.448968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:13:51.455144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b151-e9c0-4f68-8199-2a35a8d290c8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:51.455584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b151-e9c0-4f68-8199-2a35a8d290c8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:51.455722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295b151-e9c0-4f68-8199-2a35a8d290c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:51.476076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5295b151-e9c0-4f68-8199-2a35a8d290c8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:51.477304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5295b151-e9c0-4f68-8199-2a35a8d290c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:51.485912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:13:52.046327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d14a7-2bde-4b55-b5d1-292536781b7b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:52.048042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-291d14a7-2bde-4b55-b5d1-292536781b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:52.122860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:52.138443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d14a7-2bde-4b55-b5d1-292536781b7b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:52.142805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85371e-99a5-4dcb-9950-1ef5dec8b3f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:52.143436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85371e-99a5-4dcb-9950-1ef5dec8b3f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:52.143717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85371e-99a5-4dcb-9950-1ef5dec8b3f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:52.143991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85371e-99a5-4dcb-9950-1ef5dec8b3f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:52.153192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85371e-99a5-4dcb-9950-1ef5dec8b3f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:52.154803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85371e-99a5-4dcb-9950-1ef5dec8b3f7 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:52.164747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 765/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:13:54.084111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56e97-cb76-4a3b-b2d6-5a65174611fe None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:54.084653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56e97-cb76-4a3b-b2d6-5a65174611fe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:54.084653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c56e97-cb76-4a3b-b2d6-5a65174611fe None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:54.086032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 08:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:13:54.091315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11ceb-fc88-4758-98ac-93218a2cc690 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:54.091744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11ceb-fc88-4758-98ac-93218a2cc690 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:54.091879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11ceb-fc88-4758-98ac-93218a2cc690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:54.114369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-51c11ceb-fc88-4758-98ac-93218a2cc690 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:13:54.115592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-51c11ceb-fc88-4758-98ac-93218a2cc690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:54.123544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 08:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:13:54.676821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56e97-cb76-4a3b-b2d6-5a65174611fe None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:13:54.678581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-06c56e97-cb76-4a3b-b2d6-5a65174611fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:13:54.686114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:13:54.693137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c56e97-cb76-4a3b-b2d6-5a65174611fe None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:13:54.696671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979adab-24c7-4927-a7cc-4225bb08c136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:13:54.697287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979adab-24c7-4927-a7cc-4225bb08c136 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:13:54.697568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979adab-24c7-4927-a7cc-4225bb08c136 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:13:54.697837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979adab-24c7-4927-a7cc-4225bb08c136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:13:54.707851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979adab-24c7-4927-a7cc-4225bb08c136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:13:54.709274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979adab-24c7-4927-a7cc-4225bb08c136 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:13:54.719520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 773/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:14:04.107847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=11 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:14:04.714537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:20.937156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff185c-f8d4-408d-b37c-47676a6111e0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:20.938363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff185c-f8d4-408d-b37c-47676a6111e0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:20.938866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff185c-f8d4-408d-b37c-47676a6111e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:20.962012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-78ff185c-f8d4-408d-b37c-47676a6111e0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:20.963642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-78ff185c-f8d4-408d-b37c-47676a6111e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:20.977563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 767/1540] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:20.986974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a514-5b59-4b55-9ac0-be30095af593 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:20.992286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a514-5b59-4b55-9ac0-be30095af593 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:20.992811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a514-5b59-4b55-9ac0-be30095af593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.027736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fd88a514-5b59-4b55-9ac0-be30095af593 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.029336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fd88a514-5b59-4b55-9ac0-be30095af593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.039453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 774/1541] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.044193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff185c-f8d4-408d-b37c-47676a6111e0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.059459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff185c-f8d4-408d-b37c-47676a6111e0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.066603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.067655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.068165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.068660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.069600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:21.070372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.072623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.093926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 768/1542] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:21.102546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a514-5b59-4b55-9ac0-be30095af593 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.116420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a514-5b59-4b55-9ac0-be30095af593 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.126213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.127435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.127942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.128431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.129318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.131555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.202946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 775/1543] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:21.206923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.224635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5bb36-b2d3-4663-9086-4b910148976b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.311471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.312530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.313046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.313535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.314490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.316973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.355840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 769/1544] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:21.360658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.372964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88281815-1b36-4ef7-ab65-852a3596b8d7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.381642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7576-4bc6-4ea4-80fa-cb033d661f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.382711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7576-4bc6-4ea4-80fa-cb033d661f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.383216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7576-4bc6-4ea4-80fa-cb033d661f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.383702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7576-4bc6-4ea4-80fa-cb033d661f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.384570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7576-4bc6-4ea4-80fa-cb033d661f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.386849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7576-4bc6-4ea4-80fa-cb033d661f52 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.402754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 776/1545] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:21.407603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.410418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a61d-d5e3-4e74-a207-de557e420ee7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.410707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a61d-d5e3-4e74-a207-de557e420ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.410986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26a61d-d5e3-4e74-a207-de557e420ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.423658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfea2c-15a4-46ba-9a64-df7c80f3d586 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.438705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.439922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.440453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.440973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.441843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.452648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.466936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-df26a61d-d5e3-4e74-a207-de557e420ee7 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.468939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-df26a61d-d5e3-4e74-a207-de557e420ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.485319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 770/1546] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:21.488071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 777/1547] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.489500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.503413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760702f9-06f6-4b05-b808-800c11963437 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.504572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552f4f-ab3c-41d1-bf8b-93aae4468ebe None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.504855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552f4f-ab3c-41d1-bf8b-93aae4468ebe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.505128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78552f4f-ab3c-41d1-bf8b-93aae4468ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.516324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b62c3-7f2e-42ae-bef3-d22664a4bfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.517475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b62c3-7f2e-42ae-bef3-d22664a4bfd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.530981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b62c3-7f2e-42ae-bef3-d22664a4bfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.530981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b62c3-7f2e-42ae-bef3-d22664a4bfd6 admin admin] PATH_INFO: `/v3/projects/b04f4d69109f418e94c4a75a222367f3/users/5836a21647964f308aca34b92fb28f15/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.561085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-78552f4f-ab3c-41d1-bf8b-93aae4468ebe None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.562333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b62c3-7f2e-42ae-bef3-d22664a4bfd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04f4d69109f418e94c4a75a222367f3, user_id=5836a21647964f308aca34b92fb28f15, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.563402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-437b62c3-7f2e-42ae-bef3-d22664a4bfd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:21.563402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:15:21.563402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:15:21.565432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b62c3-7f2e-42ae-bef3-d22664a4bfd6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.567538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-78552f4f-ab3c-41d1-bf8b-93aae4468ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.588539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 778/1548] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:21.590675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055a7c-6757-4c96-849b-8fd84b13cbdd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.590675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055a7c-6757-4c96-849b-8fd84b13cbdd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.590982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01055a7c-6757-4c96-849b-8fd84b13cbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.619437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 771/1549] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:21 2022] PUT /identity/v3/projects/b04f4d69109f418e94c4a75a222367f3/users/5836a21647964f308aca34b92fb28f15/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:21.620787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041294f1-0915-4231-9706-538a5eb9440a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.621972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041294f1-0915-4231-9706-538a5eb9440a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.621972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041294f1-0915-4231-9706-538a5eb9440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.635502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-01055a7c-6757-4c96-849b-8fd84b13cbdd None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.637074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-01055a7c-6757-4c96-849b-8fd84b13cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.669271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-041294f1-0915-4231-9706-538a5eb9440a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.670729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-041294f1-0915-4231-9706-538a5eb9440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.715299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 779/1550] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.718475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055a7c-6757-4c96-849b-8fd84b13cbdd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.731469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01055a7c-6757-4c96-849b-8fd84b13cbdd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.736659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.737397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.737772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.738138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.738934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:21.739327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.740469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:21.740469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 01 08:15:21.740469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: Sep 01 08:15:21.741574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98419c5b-8681-4d27-8588-ecb12560539f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.747286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 772/1551] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.748616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2870e-ae2b-42ba-91da-b5ffe82aab61 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.748900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2870e-ae2b-42ba-91da-b5ffe82aab61 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.749178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2870e-ae2b-42ba-91da-b5ffe82aab61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.764625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 780/1552] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:21.766366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddc535-2c00-4af9-afa0-d0806afb534a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.766820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddc535-2c00-4af9-afa0-d0806afb534a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.767138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddc535-2c00-4af9-afa0-d0806afb534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.775319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1fa2870e-ae2b-42ba-91da-b5ffe82aab61 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.776873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1fa2870e-ae2b-42ba-91da-b5ffe82aab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.786914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 773/1553] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.788415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba5b8f-4c8d-4f46-9cf6-369c4e21c703 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.788699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba5b8f-4c8d-4f46-9cf6-369c4e21c703 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.788977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba5b8f-4c8d-4f46-9cf6-369c4e21c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.789688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-04ddc535-2c00-4af9-afa0-d0806afb534a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.791063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-04ddc535-2c00-4af9-afa0-d0806afb534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.799338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 781/1554] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.803832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddefbb-6d0e-43a4-a739-9a37a44fbbfc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.804269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddefbb-6d0e-43a4-a739-9a37a44fbbfc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.804699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ddefbb-6d0e-43a4-a739-9a37a44fbbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.809864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6fba5b8f-4c8d-4f46-9cf6-369c4e21c703 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.811674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6fba5b8f-4c8d-4f46-9cf6-369c4e21c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.820093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 774/1555] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.821320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e0785-b5ca-4476-851a-4d3cb0f59890 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.821603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e0785-b5ca-4476-851a-4d3cb0f59890 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.821876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e0785-b5ca-4476-851a-4d3cb0f59890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.825537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b9ddefbb-6d0e-43a4-a739-9a37a44fbbfc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.827628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b9ddefbb-6d0e-43a4-a739-9a37a44fbbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.836481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 782/1556] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.838026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee210d0-5b74-48f9-bfa2-920bdc5e66d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.838478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee210d0-5b74-48f9-bfa2-920bdc5e66d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.838828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee210d0-5b74-48f9-bfa2-920bdc5e66d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.843359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-041e0785-b5ca-4476-851a-4d3cb0f59890 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.844857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-041e0785-b5ca-4476-851a-4d3cb0f59890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.853122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 775/1557] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.853990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e0785-b5ca-4476-851a-4d3cb0f59890 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.862234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1ee210d0-5b74-48f9-bfa2-920bdc5e66d8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.863462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1ee210d0-5b74-48f9-bfa2-920bdc5e66d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.864027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e0785-b5ca-4476-851a-4d3cb0f59890 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.868791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282df03-487d-4b58-8779-2b7c439c582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:21.869390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282df03-487d-4b58-8779-2b7c439c582d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.869669 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282df03-487d-4b58-8779-2b7c439c582d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.869945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282df03-487d-4b58-8779-2b7c439c582d admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.870623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282df03-487d-4b58-8779-2b7c439c582d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:21.871629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-1282df03-487d-4b58-8779-2b7c439c582d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:21.871629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:15:21.871629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:15:21.871911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 783/1558] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.872827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282df03-487d-4b58-8779-2b7c439c582d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:21.872947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1132e-b44d-4f66-b46f-1afd39478f04 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.873115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1132e-b44d-4f66-b46f-1afd39478f04 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.873376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1132e-b44d-4f66-b46f-1afd39478f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.889013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:21.894392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d8a1132e-b44d-4f66-b46f-1afd39478f04 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.895944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d8a1132e-b44d-4f66-b46f-1afd39478f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.907024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 776/1559] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:21.907256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 784/1560] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.907256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1132e-b44d-4f66-b46f-1afd39478f04 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:21.907457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd455f-7709-4459-897a-7bfaafc943c9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.907457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd455f-7709-4459-897a-7bfaafc943c9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.907457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd455f-7709-4459-897a-7bfaafc943c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:21.926423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fdcd455f-7709-4459-897a-7bfaafc943c9 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:21.927748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fdcd455f-7709-4459-897a-7bfaafc943c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:21.968998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1132e-b44d-4f66-b46f-1afd39478f04 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:21.980595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:21.988958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 777/1561] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:21.990372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0a93-c3cb-4a4f-a58a-103259abd59d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:21.990668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0a93-c3cb-4a4f-a58a-103259abd59d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:21.990938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed0a93-c3cb-4a4f-a58a-103259abd59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.011198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e8ed0a93-c3cb-4a4f-a58a-103259abd59d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:22.012399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e8ed0a93-c3cb-4a4f-a58a-103259abd59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:22.021383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 778/1562] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:22.022733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bae74c-e600-4c78-9c90-9b4a6f9e91cf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.023010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bae74c-e600-4c78-9c90-9b4a6f9e91cf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.023293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bae74c-e600-4c78-9c90-9b4a6f9e91cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.024247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.024918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.025255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.025539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.035229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.036690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.043628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e4bae74c-e600-4c78-9c90-9b4a6f9e91cf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:22.044841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4bae74c-e600-4c78-9c90-9b4a6f9e91cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:22.046676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 785/1563] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:22.047507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.053404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 779/1564] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:22.054274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bae74c-e600-4c78-9c90-9b4a6f9e91cf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.060632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc884e0e-3472-4e41-8dbd-13e42089b024 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.065510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bae74c-e600-4c78-9c90-9b4a6f9e91cf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.065892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3e0f4-1dd4-452e-9ed7-096eae1f58fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.066536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e0f4-1dd4-452e-9ed7-096eae1f58fd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.066818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e0f4-1dd4-452e-9ed7-096eae1f58fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.067093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3e0f4-1dd4-452e-9ed7-096eae1f58fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.067962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3e0f4-1dd4-452e-9ed7-096eae1f58fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:22.068269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3e0f4-1dd4-452e-9ed7-096eae1f58fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.069891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3e0f4-1dd4-452e-9ed7-096eae1f58fd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.070663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.071226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.071553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.071755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.072650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:22.072899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.074720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.085307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 786/1565] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:22.092757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 780/1566] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:22.092757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.094690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df896ed-d9a9-4208-aab1-670b44f56651 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.094987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df896ed-d9a9-4208-aab1-670b44f56651 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.095441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df896ed-d9a9-4208-aab1-670b44f56651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.100997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215558-f19b-4692-8c40-6d9f99deac00 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.108064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.109317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.109317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.109535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.110116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.112121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.115677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7df896ed-d9a9-4208-aab1-670b44f56651 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:22.117263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7df896ed-d9a9-4208-aab1-670b44f56651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:22.127545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 787/1567] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:22.128622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df896ed-d9a9-4208-aab1-670b44f56651 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.141419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 781/1568] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/users => generated 292 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.141419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.145085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df896ed-d9a9-4208-aab1-670b44f56651 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.149217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.150328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.150721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.150981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.152342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:22.152640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.154376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.155492 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18070ef7-a515-42fb-aa95-e07b1da401d9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.160692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.161388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.161738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.162090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.163063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:22.163193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.164781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.169062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 788/1569] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:22.169870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.178926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 782/1570] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:22.181193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd86cd6-f110-4fc1-af45-c00bc2ba3149 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.187463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.188355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.188967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.189298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.189613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.190261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:22.190562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.192429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.201349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca599e-4d8f-4fac-9b07-8592c256c8bc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.205998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 789/1571] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:22.206719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.209883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.210755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.211213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.211707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.212547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.214723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.222151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77241b-5a79-4fef-b89a-13fb7a3f0ffd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.227019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.227707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.228242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.228370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.228972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.230999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.258434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 783/1572] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/projects => generated 375 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.259165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.276884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 790/1573] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.276884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.336733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103ed31-0a6b-4e16-ad1a-9b14e768e001 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.347392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db153c29-ed6f-4d2b-8eed-1b40d9160b1a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.353832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.354687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.354985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.355426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.356211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.359222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.362305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:22.370322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 791/1574] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:22.375435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.388535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8400-9c1a-4de1-971e-937152c50598 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.393675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.394322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.394702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.394868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.395492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.397435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.415354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.416093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.416335 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.416615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.417279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:22.417616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.419285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.429977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 792/1575] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.431216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.439905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 784/1576] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:22.441254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.455156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742941-b5b2-40f3-a245-6ad5a81b76a9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.470853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:22.518126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d42e0-ba1e-4fc6-87f2-e63eddcdfcd2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.523966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.524596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.524870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.525137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.525861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.528964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.546937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.548040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.548571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.549054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.549912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.551933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.560125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 793/1577] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.561154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.591462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 785/1578] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.593560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.639949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee267109-35fb-414d-b91c-b9ee318e1eee admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.668332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad1cd-1db3-46fc-8eeb-78e86c3c0c5d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.674839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.675640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.676024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.676390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.677137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.679526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.705140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 786/1579] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.706130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.718225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.719498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.719924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.720052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.721020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.722000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa014-6e75-4fd7-b23e-f01cb6ba2639 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.722137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:22.722137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 01 08:15:22.722137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: Sep 01 08:15:22.723433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.728001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.728687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.729038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.729564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.730105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.731864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.746616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 787/1580] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:22.746616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.757299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 794/1581] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.758892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.760419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce01fc-8b1c-43e0-aff9-80625eb752d3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.769529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.770171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.770736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.771018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.771975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.774128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.782685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e20b1-50da-4e70-b765-4df45413be39 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.797456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.798697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.799319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.800074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.801444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.803871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.819971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 788/1582] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/users => generated 289 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.821094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.827892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:22.836527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15bbd-8f74-497f-bc7a-90fcc67cbcfe admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.848533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.849176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.849504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.849783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.851069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.854727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.860807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 795/1583] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.860807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.890205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 789/1584] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/users => generated 283 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.891045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.898740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:22.915412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141a90e-d324-48df-be69-ff0baebfe220 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.945032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e7fb0-6fe3-4932-9e7c-dd34f72669b1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:22.950838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:22.951469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:22.952300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:22.952572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:22.953380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:22.955814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:22.985451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 796/1585] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:22 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:22.985451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:22.996383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44102ad-e557-4efd-b4c6-c41d2cffab29 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.002543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.002763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.003349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.003540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.003681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.003966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] PATH_INFO: `/v3/projects/d3383da1814b4bb1b0266935ab78ad86/users/7b86a495e5364b60bc9ea590c3ea80fb/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.004085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.005538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.006366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.008800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.022806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3383da1814b4bb1b0266935ab78ad86, user_id=7b86a495e5364b60bc9ea590c3ea80fb, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.025939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.043326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 790/1586] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.044240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.050937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 797/1587] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:22 2022] PUT /identity/v3/projects/d3383da1814b4bb1b0266935ab78ad86/users/7b86a495e5364b60bc9ea590c3ea80fb/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:23.065132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.070199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26575a9c-9ab5-49c2-8775-23065b72fa8e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.155234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06fd1a-9973-4b04-9a91-d860a214daf3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.161128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.161466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.161926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.162215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.162367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.162748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.162854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.163028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.163567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.164384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.166378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.166517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.183577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 791/1588] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.183577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.183899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 798/1589] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.187890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.197060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed9938-a471-45a7-b630-58a67a484401 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.199280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d1f36-1a6e-4b0f-874a-ee1b32e44972 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.203155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.203775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.204055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.204328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.204982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.205299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.206014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.206439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.206814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.206952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.207649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.209936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.218598 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 799/1590] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.219243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.235056 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a27e6-5cc9-4e17-ad64-613a9773d0f7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.240109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558cae-50e6-4539-b27f-67c3d7b79c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.240722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558cae-50e6-4539-b27f-67c3d7b79c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.241006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558cae-50e6-4539-b27f-67c3d7b79c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.241281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558cae-50e6-4539-b27f-67c3d7b79c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.242288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558cae-50e6-4539-b27f-67c3d7b79c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.243918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558cae-50e6-4539-b27f-67c3d7b79c6d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.247569 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 792/1591] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:23 2022] POST /identity/v3/users => generated 297 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:23.249927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.257050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 800/1592] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.258467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637671d-bc86-49fb-a4b3-bccafd963e79 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.258751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637671d-bc86-49fb-a4b3-bccafd963e79 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.259021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637671d-bc86-49fb-a4b3-bccafd963e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.266131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dec1f-f715-4dce-904f-bb569dc0f4c2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.273266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.275127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.275661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.276608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.277657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.279579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.302552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 793/1593] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.302552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.302873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5637671d-bc86-49fb-a4b3-bccafd963e79 None None] MFA Rules not processed for user `7b86a495e5364b60bc9ea590c3ea80fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:23.303445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5637671d-bc86-49fb-a4b3-bccafd963e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:23.316118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9df128-5ed4-43f0-804e-7d03c20d0357 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.322065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.322722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.323002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.323276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.324233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.327095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.341308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 794/1594] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.343107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.355202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c6851-181f-473d-84d6-8106e52f5e15 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.363882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.365163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.365897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.366375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.367384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.369380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.372304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:23.389381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 795/1595] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.390576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.402101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 801/1596] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:23.402101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637671d-bc86-49fb-a4b3-bccafd963e79 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.406649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60fd53-acfb-457c-a033-a74ab91e0195 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.412912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.413584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.414022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.414384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.417015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.417015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.432204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637671d-bc86-49fb-a4b3-bccafd963e79 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.433158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 796/1597] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.434576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.444023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.444831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.445121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.445580 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.449657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.451376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.454089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf815a6a-b70c-4a18-9732-d92262735925 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.461239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.461968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.462269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.462577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.463242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.466196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.475854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 802/1598] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.475854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.486588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 797/1599] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.486588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.490204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608ed8e-3045-4ca8-943d-6a15e131685d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.492582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:23.496374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.497934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc5b4-ea5e-4c94-a79e-504fa02ee0f9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.498330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.499022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.499418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] PATH_INFO: `/v3/projects/3f10afed724e47cfab9f438411d73992/users/93c8237bd14c40dda53daecb949a33ae/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.506539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277c20e-cad6-4bfd-8ff6-c02d270cfec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.507439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c20e-cad6-4bfd-8ff6-c02d270cfec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.507919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c20e-cad6-4bfd-8ff6-c02d270cfec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.508419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277c20e-cad6-4bfd-8ff6-c02d270cfec2 admin admin] PATH_INFO: `/v3/projects/0a10226de44d4050839cfa0a11066bc7/users/98fc7b08006741ae9b0a217ce7fe8c92/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.519168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f10afed724e47cfab9f438411d73992, user_id=93c8237bd14c40dda53daecb949a33ae, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.522291 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.531757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277c20e-cad6-4bfd-8ff6-c02d270cfec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a10226de44d4050839cfa0a11066bc7, user_id=98fc7b08006741ae9b0a217ce7fe8c92, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.534653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277c20e-cad6-4bfd-8ff6-c02d270cfec2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.544422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 803/1600] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:23 2022] PUT /identity/v3/projects/3f10afed724e47cfab9f438411d73992/users/93c8237bd14c40dda53daecb949a33ae/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:23.545459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.561431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 798/1601] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:23 2022] PUT /identity/v3/projects/0a10226de44d4050839cfa0a11066bc7/users/98fc7b08006741ae9b0a217ce7fe8c92/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:23.561431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e516-b14c-4f72-b0cc-5b3417cb5458 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.561431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e516-b14c-4f72-b0cc-5b3417cb5458 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.561431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e516-b14c-4f72-b0cc-5b3417cb5458 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.562031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 799/1602] 10.222.0.36 () {54 vars in 962 bytes} [Thu Sep 1 08:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:23.562502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e516-b14c-4f72-b0cc-5b3417cb5458 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.644458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14efc5d3-add4-4509-a1e1-3792187c26af admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.669325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e516-b14c-4f72-b0cc-5b3417cb5458 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.675614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.677148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.677425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.677696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] PATH_INFO: `/v3/projects/99d7c073d42b4d5c97b7bb67f58318b0/users/8c9552c320544c0296c8f65221bc6e07/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.711034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d7c073d42b4d5c97b7bb67f58318b0, user_id=8c9552c320544c0296c8f65221bc6e07, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.713912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.731870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 800/1603] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:23 2022] PUT /identity/v3/projects/99d7c073d42b4d5c97b7bb67f58318b0/users/8c9552c320544c0296c8f65221bc6e07/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:23.733489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.735804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.736517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.736849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.737102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] PATH_INFO: `/v3/projects/bfa00173a09c4dcfb47f59906ee3ad45/users/b1599a00c71c48eb87452d8f52150c01/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.763046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa00173a09c4dcfb47f59906ee3ad45, user_id=b1599a00c71c48eb87452d8f52150c01, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.775848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.798071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 804/1604] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:23 2022] PUT /identity/v3/projects/bfa00173a09c4dcfb47f59906ee3ad45/users/b1599a00c71c48eb87452d8f52150c01/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:23.799329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:23.819825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9685f211-9bd1-456b-a101-03b26c572e8f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.881300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:23.906623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18e566-7fcf-4bd3-94b2-d2893fef9d01 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:23.908962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b983c35-4040-4c20-be39-ec8a9e26e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.986094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983c35-4040-4c20-be39-ec8a9e26e6ed admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.986094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983c35-4040-4c20-be39-ec8a9e26e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.986094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b983c35-4040-4c20-be39-ec8a9e26e6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.986094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b983c35-4040-4c20-be39-ec8a9e26e6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.986734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd63935-2e47-4d7f-b01b-102278c98278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:23.987035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b983c35-4040-4c20-be39-ec8a9e26e6ed admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.987142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63935-2e47-4d7f-b01b-102278c98278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.987142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63935-2e47-4d7f-b01b-102278c98278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.987142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd63935-2e47-4d7f-b01b-102278c98278 admin admin] PATH_INFO: `/v3/projects/de0e3badc16e49caa138daab8d376e24/users/08eb034fd8564f199e864c48b8a6162d/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.987404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 801/1605] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:23.987404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2c5f7-b7ec-47f4-a870-95df0b795b0d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.987404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2c5f7-b7ec-47f4-a870-95df0b795b0d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.987404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2c5f7-b7ec-47f4-a870-95df0b795b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:23.987709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd63935-2e47-4d7f-b01b-102278c98278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de0e3badc16e49caa138daab8d376e24, user_id=08eb034fd8564f199e864c48b8a6162d, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:23.987709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd63935-2e47-4d7f-b01b-102278c98278 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:23.987888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:23.987888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f6c2c5f7-b7ec-47f4-a870-95df0b795b0d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:23.987888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f6c2c5f7-b7ec-47f4-a870-95df0b795b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:23.990476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 802/1606] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:23.992230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261a54-0a22-42a1-bb16-67bd9b688763 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:23.992833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261a54-0a22-42a1-bb16-67bd9b688763 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:23.993106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3261a54-0a22-42a1-bb16-67bd9b688763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.001750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 805/1607] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:23 2022] PUT /identity/v3/projects/de0e3badc16e49caa138daab8d376e24/users/08eb034fd8564f199e864c48b8a6162d/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:24.020363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d3261a54-0a22-42a1-bb16-67bd9b688763 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:24.021622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d3261a54-0a22-42a1-bb16-67bd9b688763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:24.029456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6505d-11f4-4249-b728-0997fab65363 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.032822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6505d-11f4-4249-b728-0997fab65363 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.033297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6505d-11f4-4249-b728-0997fab65363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.105426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cca6505d-11f4-4249-b728-0997fab65363 None None] MFA Rules not processed for user `3a545f5fde0d432fbe31819eb5c7c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:24.107806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cca6505d-11f4-4249-b728-0997fab65363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:24.127395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 803/1608] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:24.128522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc18fd-3f82-4ea5-b300-a4c2154c302e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.128861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc18fd-3f82-4ea5-b300-a4c2154c302e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.129145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc18fd-3f82-4ea5-b300-a4c2154c302e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.172945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-53bc18fd-3f82-4ea5-b300-a4c2154c302e None None] MFA Rules not processed for user `8c9552c320544c0296c8f65221bc6e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:24.174095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53bc18fd-3f82-4ea5-b300-a4c2154c302e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:24.204933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 806/1609] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Sep 1 08:15:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:24.206075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.206410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.206689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.238695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] MFA Rules not processed for user `b1599a00c71c48eb87452d8f52150c01`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:24.240157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:24.251274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 804/1610] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:24.251953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc18fd-3f82-4ea5-b300-a4c2154c302e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:24.267648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc18fd-3f82-4ea5-b300-a4c2154c302e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:24.272731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f55c4c-14f5-4096-aafb-14c179cfd766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:24.273413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f55c4c-14f5-4096-aafb-14c179cfd766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.273694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f55c4c-14f5-4096-aafb-14c179cfd766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.274406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f55c4c-14f5-4096-aafb-14c179cfd766 admin admin] PATH_INFO: `/v3/projects/3de02deda353493f804a8123db6ab321/users/2bc03f8cc95c4f2da66897f3150e7efb/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.294750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f55c4c-14f5-4096-aafb-14c179cfd766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de02deda353493f804a8123db6ab321, user_id=2bc03f8cc95c4f2da66897f3150e7efb, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:24.299270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f55c4c-14f5-4096-aafb-14c179cfd766 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:24.318309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 805/1611] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:24 2022] PUT /identity/v3/projects/3de02deda353493f804a8123db6ab321/users/2bc03f8cc95c4f2da66897f3150e7efb/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:24.318309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34952f-ab82-4397-83db-99ea9d6b046a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.318309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34952f-ab82-4397-83db-99ea9d6b046a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.318689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34952f-ab82-4397-83db-99ea9d6b046a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.332387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 807/1612] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:24.333612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:24.335230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:24.349891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bf34952f-ab82-4397-83db-99ea9d6b046a None None] MFA Rules not processed for user `08eb034fd8564f199e864c48b8a6162d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:24.351393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf34952f-ab82-4397-83db-99ea9d6b046a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:24.387203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:24.405479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e9425-7734-412e-ae19-67b2c8906974 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:24.423252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:24.441994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 806/1613] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:24.445975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34952f-ab82-4397-83db-99ea9d6b046a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:24.480347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:24.481066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.481460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.481803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.546023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34952f-ab82-4397-83db-99ea9d6b046a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:24.550422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:24.551052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.551332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.551604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.575913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:24.580232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:24.605676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 808/1614] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:24.607475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:24.638515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:24.640498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:24.657880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 807/1615] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:24.658984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:24.720941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b11ac-7ef4-4438-b5bc-6513fd491452 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:24.729204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce818f12-b810-45a2-8f74-e712e7ae7d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:24.730516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce818f12-b810-45a2-8f74-e712e7ae7d5e service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.731132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce818f12-b810-45a2-8f74-e712e7ae7d5e service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.731576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce818f12-b810-45a2-8f74-e712e7ae7d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.801183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93fcd1-af9a-4c7e-9487-551233948423 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:24.806163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:24.806876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.807159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.807478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.829634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:24.860455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce818f12-b810-45a2-8f74-e712e7ae7d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:24.862820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce818f12-b810-45a2-8f74-e712e7ae7d5e service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:24.898639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 809/1616] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:24.903350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a23fa-17e6-42d4-90c6-a49b11975f90 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:24.903634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a23fa-17e6-42d4-90c6-a49b11975f90 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:24.904021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a23fa-17e6-42d4-90c6-a49b11975f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:24.954183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:24.958044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:24.968713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:24.977267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 808/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:24.978946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:24.982639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8d0a23fa-17e6-42d4-90c6-a49b11975f90 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:24.989356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8d0a23fa-17e6-42d4-90c6-a49b11975f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:25.002339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 810/1618] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:25.003054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39227931-dd7c-499c-a43d-457707076414 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.003820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a23fa-17e6-42d4-90c6-a49b11975f90 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.013681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.017120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a23fa-17e6-42d4-90c6-a49b11975f90 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.024075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.024978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.025246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.025535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.026261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.026925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.030554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.031403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.033449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.039621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.040186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.115612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 811/1619] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:25 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:25.115612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.153931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 809/1620] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:24 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:25.163419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.271355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ff8a-f13a-4e73-86a0-ac1fbcf69be5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.335743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68646f-11ec-4d4e-bca0-d2ad28a9ca3c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.352287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.353036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.353225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.353505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.354222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.362028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.412417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.413663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.413875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.414153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.428596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 810/1621] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:25 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:25.429940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.439941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.442610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.465486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758d4ba-a3dd-4995-9135-150d2ec407fe admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.469130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 812/1622] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:25.471439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.487519 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.488182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.488635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.489217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.493019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.499477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06690f18-ea76-4616-a34e-00824eaa63ac service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.502143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.518325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.523245 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.523769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.524290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.525741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.532017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.568615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 811/1623] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:25 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:25.569762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.579599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 813/1624] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:25.580642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.611223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cb390-b105-43c3-9c2a-003ba9fbd334 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.620528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc609c7d-7ce0-47c8-b28d-0ed6256e8f75 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.634865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.635516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.635790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.636063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] PATH_INFO: `/v3/projects/398e1e5b32054988a0c290d0e49cd87b/users/298d4d0ec1594f46a2dd641087e83c33/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.649222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.653363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.654035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.654420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.655566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.660592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.693703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398e1e5b32054988a0c290d0e49cd87b, user_id=298d4d0ec1594f46a2dd641087e83c33, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.696518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.712232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 812/1625] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:25.713396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.734135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 814/1626] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:25 2022] PUT /identity/v3/projects/398e1e5b32054988a0c290d0e49cd87b/users/298d4d0ec1594f46a2dd641087e83c33/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:25.743804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:25.749477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238f63a-344c-4074-a075-b1d98b061bdf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.868590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55b3a1-3945-4c33-8d44-d4627a68c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:25.870738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b3a1-3945-4c33-8d44-d4627a68c361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.871322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b3a1-3945-4c33-8d44-d4627a68c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.872120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55b3a1-3945-4c33-8d44-d4627a68c361 admin admin] PATH_INFO: `/v3/projects/3edd71e4f7c947fab1e3318bdde02943/users/0e22854551ec465f9457200a0892679e/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.877085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:25.910572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55b3a1-3945-4c33-8d44-d4627a68c361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edd71e4f7c947fab1e3318bdde02943, user_id=0e22854551ec465f9457200a0892679e, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:25.916096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55b3a1-3945-4c33-8d44-d4627a68c361 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:25.949445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 813/1627] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:25 2022] PUT /identity/v3/projects/3edd71e4f7c947fab1e3318bdde02943/users/0e22854551ec465f9457200a0892679e/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:25.953290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2173ca-cf04-4492-9204-857ec45be637 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:25.955248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34396-d1fa-443b-b3f9-e4d778c6c4f9 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:25.956182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34396-d1fa-443b-b3f9-e4d778c6c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:25.957878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff34396-d1fa-443b-b3f9-e4d778c6c4f9 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:25.962297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 814/1628] 10.222.0.36 () {54 vars in 912 bytes} [Thu Sep 1 08:15:25 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:25.969236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34396-d1fa-443b-b3f9-e4d778c6c4f9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:26.055093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:26.101301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5664aec-f18e-4f32-aa60-27cfb3b484c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:26.102650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664aec-f18e-4f32-aa60-27cfb3b484c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.103159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664aec-f18e-4f32-aa60-27cfb3b484c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.103638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5664aec-f18e-4f32-aa60-27cfb3b484c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.105093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5664aec-f18e-4f32-aa60-27cfb3b484c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:26.108497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5664aec-f18e-4f32-aa60-27cfb3b484c1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:26.131506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 815/1629] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:26.133987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a924e4-406e-4f8a-8b5f-4b9bb2ab345d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.136239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a924e4-406e-4f8a-8b5f-4b9bb2ab345d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.136791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a924e4-406e-4f8a-8b5f-4b9bb2ab345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.159649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff34396-d1fa-443b-b3f9-e4d778c6c4f9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:26.175148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:26.175887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.176381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.176863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.178031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:26.179977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:26.188283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-47a924e4-406e-4f8a-8b5f-4b9bb2ab345d None None] MFA Rules not processed for user `3a545f5fde0d432fbe31819eb5c7c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:26.193311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47a924e4-406e-4f8a-8b5f-4b9bb2ab345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:26.211367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 815/1630] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:26.212688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:26.236947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd04a97-acf6-4d0f-9f4f-898e8fb60c21 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:26.253233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:26.254269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.254636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.254983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] PATH_INFO: `/v3/projects/398e1e5b32054988a0c290d0e49cd87b/users/298d4d0ec1594f46a2dd641087e83c33/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.260663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=398e1e5b32054988a0c290d0e49cd87b, user_id=298d4d0ec1594f46a2dd641087e83c33, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:26.263719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:26.323966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 816/1631] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:26 2022] PUT /identity/v3/projects/398e1e5b32054988a0c290d0e49cd87b/users/298d4d0ec1594f46a2dd641087e83c33/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:26.323966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:26.350465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 816/1632] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:26.352183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3dfc-f4fd-4ea9-a89c-04d6f6124222 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.352599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3dfc-f4fd-4ea9-a89c-04d6f6124222 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.352718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d3dfc-f4fd-4ea9-a89c-04d6f6124222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.419130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-176d3dfc-f4fd-4ea9-a89c-04d6f6124222 None None] MFA Rules not processed for user `298d4d0ec1594f46a2dd641087e83c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:26.424033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-176d3dfc-f4fd-4ea9-a89c-04d6f6124222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:26.471618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c5007-f043-4a02-8532-d2b55ab0c8ea admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:26.492437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:26.493132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.493414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.493703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] PATH_INFO: `/v3/projects/3edd71e4f7c947fab1e3318bdde02943/users/0e22854551ec465f9457200a0892679e/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.495764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edd71e4f7c947fab1e3318bdde02943, user_id=0e22854551ec465f9457200a0892679e, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:26.499133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:26.543972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 817/1633] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:26 2022] PUT /identity/v3/projects/3edd71e4f7c947fab1e3318bdde02943/users/0e22854551ec465f9457200a0892679e/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:26.545166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:26.584528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:26.603073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 817/1634] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:26.612176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e956-a6d1-4265-9ecf-fdd3d876da6a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.613357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e956-a6d1-4265-9ecf-fdd3d876da6a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.615019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5e956-a6d1-4265-9ecf-fdd3d876da6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.677668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-44f5e956-a6d1-4265-9ecf-fdd3d876da6a None None] MFA Rules not processed for user `0e22854551ec465f9457200a0892679e`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:26.679113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-44f5e956-a6d1-4265-9ecf-fdd3d876da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:26.679618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e15ec-f10f-42a7-ac6f-d981ccb657b1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:26.689530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:26.690172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.690497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.690776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.791556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 818/1635] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:26.792341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5e956-a6d1-4265-9ecf-fdd3d876da6a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:26.809717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5e956-a6d1-4265-9ecf-fdd3d876da6a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:26.815775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:26.818042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:26.818576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:26.818773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:26.823475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:26.865557 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:26.868164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:26.895558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 818/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:26.965211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:26.967210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:26.990987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 819/1637] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:27.122105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:27.134013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641ba4d-7aac-414c-bff1-b6fb4d33a075 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:27.143514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2be78c-e570-4ed4-87fb-edab569bd877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:27.144610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2be78c-e570-4ed4-87fb-edab569bd877 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:27.145923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2be78c-e570-4ed4-87fb-edab569bd877 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:27.146548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2be78c-e570-4ed4-87fb-edab569bd877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:27.169409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2be78c-e570-4ed4-87fb-edab569bd877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:27.174606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2be78c-e570-4ed4-87fb-edab569bd877 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:27.203607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 819/1638] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:27.646159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:27.660632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18773e3-c68f-485c-be19-1313f2123a5a service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:27.675918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a0157-eef1-4b29-a40d-493634299edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:27.677220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0157-eef1-4b29-a40d-493634299edf service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:27.677512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0157-eef1-4b29-a40d-493634299edf service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:27.682001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a0157-eef1-4b29-a40d-493634299edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:27.933979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a0157-eef1-4b29-a40d-493634299edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:27.937137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a0157-eef1-4b29-a40d-493634299edf service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:28.010145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 820/1639] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:28.180377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58489-189a-40f8-8af1-615ee8cfb306 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:28.180973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58489-189a-40f8-8af1-615ee8cfb306 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:28.181465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a58489-189a-40f8-8af1-615ee8cfb306 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:28.183543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 820/1640] 10.222.0.36 () {54 vars in 962 bytes} [Thu Sep 1 08:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:28.203028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99811-b559-4ea7-a19e-ae3d8ee1528c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:28.203312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99811-b559-4ea7-a19e-ae3d8ee1528c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:28.203643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99811-b559-4ea7-a19e-ae3d8ee1528c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:28.266808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7fb99811-b559-4ea7-a19e-ae3d8ee1528c None None] MFA Rules not processed for user `3a545f5fde0d432fbe31819eb5c7c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:28.268180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7fb99811-b559-4ea7-a19e-ae3d8ee1528c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:28.301018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 821/1641] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Sep 1 08:15:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:28.315801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649465-812f-4b90-84c6-c2960508d831 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:28.316209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649465-812f-4b90-84c6-c2960508d831 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:28.316598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00649465-812f-4b90-84c6-c2960508d831 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:28.318163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 821/1642] 10.222.0.36 () {54 vars in 912 bytes} [Thu Sep 1 08:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:28.324555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb7ab-4d2b-4450-813d-724afa683340 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:28.325194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb7ab-4d2b-4450-813d-724afa683340 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:28.325807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb7ab-4d2b-4450-813d-724afa683340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:28.379906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bfcfb7ab-4d2b-4450-813d-724afa683340 None None] MFA Rules not processed for user `3a545f5fde0d432fbe31819eb5c7c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:28.382145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bfcfb7ab-4d2b-4450-813d-724afa683340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:28.407360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 822/1643] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:15:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:28.455249 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649465-812f-4b90-84c6-c2960508d831 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:28.471943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00649465-812f-4b90-84c6-c2960508d831 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:28.477609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab0f62-9c74-41aa-a974-aed0d55a1686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:28.478372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0f62-9c74-41aa-a974-aed0d55a1686 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:28.478755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0f62-9c74-41aa-a974-aed0d55a1686 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:28.479241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab0f62-9c74-41aa-a974-aed0d55a1686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:28.503962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab0f62-9c74-41aa-a974-aed0d55a1686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:28.506754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab0f62-9c74-41aa-a974-aed0d55a1686 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:28.522437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 822/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:28.792688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb7ab-4d2b-4450-813d-724afa683340 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:28.801017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:28.886884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb7ab-4d2b-4450-813d-724afa683340 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:28.900965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:28.901774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:28.902190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:28.902627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] PATH_INFO: `/v3/users/08eb034fd8564f199e864c48b8a6162d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:28.905683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=08eb034fd8564f199e864c48b8a6162d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:28.908828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:29.021954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08eb034fd8564f199e864c48b8a6162d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:29.052540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08eb034fd8564f199e864c48b8a6162d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:29.081050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08eb034fd8564f199e864c48b8a6162d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:29.081999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08eb034fd8564f199e864c48b8a6162d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:29.117194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08eb034fd8564f199e864c48b8a6162d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:29.140697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:29.141168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:29.141715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:29.146473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 823/1645] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:28 2022] DELETE /identity/v3/users/08eb034fd8564f199e864c48b8a6162d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:29.195428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:29.203206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:29.369140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 823/1646] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:29.425041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:29.427371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:29.708404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0409a9-2e9a-402b-8843-e9b9aba1ccdc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:29.726333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:29.734546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:29.734958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:29.735242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:29.781737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:29.783341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:29.850662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 824/1647] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:33.758751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:33.761275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:33.774452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c67c4e-f730-4f02-9593-068c8700c559 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:33.812734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:33.814179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:33.829844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:33.830508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:33.830701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:33.830979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] PATH_INFO: `/v3/projects/de0e3badc16e49caa138daab8d376e24` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:33.835888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=de0e3badc16e49caa138daab8d376e24)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:33.839030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:33.846918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db6c47-ec30-497f-b184-94c9365eae29 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:33.870540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:33.871203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:33.871490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:33.871760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] PATH_INFO: `/v3/users/7b86a495e5364b60bc9ea590c3ea80fb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:33.888238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b86a495e5364b60bc9ea590c3ea80fb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:33.905750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:34.000700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:34.085399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de0e3badc16e49caa138daab8d376e24', 'request_id': 'req-8c5faa17-1d79-4f52-a53e-f341bdd2152d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.105254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b86a495e5364b60bc9ea590c3ea80fb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.110843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de0e3badc16e49caa138daab8d376e24', 'request_id': 'req-8c5faa17-1d79-4f52-a53e-f341bdd2152d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.127461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de0e3badc16e49caa138daab8d376e24', 'request_id': 'req-8c5faa17-1d79-4f52-a53e-f341bdd2152d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.148877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b86a495e5364b60bc9ea590c3ea80fb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.160631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] The token cache is being invalidate because project de0e3badc16e49caa138daab8d376e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:34.160943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.165452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.169329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b86a495e5364b60bc9ea590c3ea80fb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.171287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 824/1648] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:33 2022] DELETE /identity/v3/projects/de0e3badc16e49caa138daab8d376e24 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:34.173594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b86a495e5364b60bc9ea590c3ea80fb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.175716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:34.178975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:34.188100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2e0afd3d-f992-4036-b638-253a0ab01bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b86a495e5364b60bc9ea590c3ea80fb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.207377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 825/1649] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:33 2022] DELETE /identity/v3/users/7b86a495e5364b60bc9ea590c3ea80fb => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:15:34.214668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:34.214957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:34.215205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:34.293051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:34.298342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:34.353229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:34.432387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5faa17-1d79-4f52-a53e-f341bdd2152d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:34.496386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 826/1650] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:34.549668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:34.551223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:34.598721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:34.599388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:34.599673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:34.599954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] PATH_INFO: `/v3/users/298d4d0ec1594f46a2dd641087e83c33` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:34.623137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298d4d0ec1594f46a2dd641087e83c33)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:34.624397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: WARNING py.warnings [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:34.624397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: warnings.warn(msg) Sep 01 08:15:34.624397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: Sep 01 08:15:34.625651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:34.772794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6753d607-9931-4e88-b9c4-6f40892bf196 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:34.789665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29e331-bd12-4106-801e-16383efb87bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:34.791023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29e331-bd12-4106-801e-16383efb87bd service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:34.791898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29e331-bd12-4106-801e-16383efb87bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:34.792343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29e331-bd12-4106-801e-16383efb87bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:34.836240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29e331-bd12-4106-801e-16383efb87bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:34.843814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29e331-bd12-4106-801e-16383efb87bd service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:34.862676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298d4d0ec1594f46a2dd641087e83c33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.891945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 827/1651] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:15:34.937952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298d4d0ec1594f46a2dd641087e83c33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.963464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298d4d0ec1594f46a2dd641087e83c33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.988023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298d4d0ec1594f46a2dd641087e83c33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:34.992261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca2622b1-0d44-490d-b505-c0c2cdc24775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298d4d0ec1594f46a2dd641087e83c33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:35.010079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 825/1652] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:34 2022] DELETE /identity/v3/users/298d4d0ec1594f46a2dd641087e83c33 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:35.568957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:35.569584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:35.570090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:35.643234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] MFA Rules not processed for user `5836a21647964f308aca34b92fb28f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:35.644762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:35.718104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:35.807648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4710d-9e2d-4725-98cc-8bd0e9d4dc7a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:35.807939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4710d-9e2d-4725-98cc-8bd0e9d4dc7a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:35.808266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4710d-9e2d-4725-98cc-8bd0e9d4dc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:35.812282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 828/1653] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:35.848370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c2c4710d-9e2d-4725-98cc-8bd0e9d4dc7a None None] MFA Rules not processed for user `5836a21647964f308aca34b92fb28f15`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:35.849740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c2c4710d-9e2d-4725-98cc-8bd0e9d4dc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:35.865881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 826/1654] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:35.898725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:35.900196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:36.056844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339909f-ef48-4907-9a91-048fd1dda340 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:36.075814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1a304-46c0-476a-acb9-0905f6b359e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:36.076717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1a304-46c0-476a-acb9-0905f6b359e9 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:36.077144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1a304-46c0-476a-acb9-0905f6b359e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:36.077560 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1a304-46c0-476a-acb9-0905f6b359e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:36.093972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1a304-46c0-476a-acb9-0905f6b359e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:36.095871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1a304-46c0-476a-acb9-0905f6b359e9 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:36.124729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 829/1655] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:37.217158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558e72-3837-47b1-9f55-174d05ed3259 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:37.218451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558e72-3837-47b1-9f55-174d05ed3259 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:37.218451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c558e72-3837-47b1-9f55-174d05ed3259 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:37.219935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 827/1656] 10.222.0.36 () {54 vars in 912 bytes} [Thu Sep 1 08:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:37.226649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:37.227708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:37.228130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:37.322023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] MFA Rules not processed for user `43048122a82e4562babb240ff090d5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:37.325067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:37.499161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 830/1657] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:15:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:37.566021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c558e72-3837-47b1-9f55-174d05ed3259 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:37.577303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8c558e72-3837-47b1-9f55-174d05ed3259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:37.646616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c558e72-3837-47b1-9f55-174d05ed3259 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:37.655011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95e07d-5a78-4874-9fc8-47627696a615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:37.655640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e07d-5a78-4874-9fc8-47627696a615 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:37.655920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e07d-5a78-4874-9fc8-47627696a615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:37.656188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95e07d-5a78-4874-9fc8-47627696a615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:37.672213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e07d-5a78-4874-9fc8-47627696a615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:37.674549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95e07d-5a78-4874-9fc8-47627696a615 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:37.691967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 828/1658] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:37.730147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:37.732426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:37.918905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:37.950589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5547dab-6636-455c-9ac4-15c7520336d7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:37.963427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:37.964145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:37.966600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:37.966881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] PATH_INFO: `/v3/projects/d3383da1814b4bb1b0266935ab78ad86` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:37.973830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3383da1814b4bb1b0266935ab78ad86)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:37.978428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: WARNING py.warnings [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 08:15:37.978428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: warnings.warn(msg) Sep 01 08:15:37.978428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: Sep 01 08:15:37.979907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:38.209279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3383da1814b4bb1b0266935ab78ad86', 'request_id': 'req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.239562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3383da1814b4bb1b0266935ab78ad86', 'request_id': 'req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.272192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3383da1814b4bb1b0266935ab78ad86', 'request_id': 'req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.308571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] The token cache is being invalidate because project d3383da1814b4bb1b0266935ab78ad86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:38.312219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.323079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ef042c90-b33f-42e5-a1fe-ccce57c2e06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.327466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 831/1659] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:37 2022] DELETE /identity/v3/projects/d3383da1814b4bb1b0266935ab78ad86 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:38.334133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:38.336489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:38.337276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:38.416587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:38.421301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:38.502819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:38.503398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:38.503813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:38.551714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:38.616008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] MFA Rules not processed for user `93c8237bd14c40dda53daecb949a33ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:38.617721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 829/1660] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:38.617905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:38.619801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:38.622730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:38.652730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fdf06-b159-4105-b1fe-bc0bbfeaf266 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:38.662637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:38.664785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:38.665637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:38.666469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] PATH_INFO: `/v3/users/b1599a00c71c48eb87452d8f52150c01` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:38.669099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1599a00c71c48eb87452d8f52150c01)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:38.675363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:38.851537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1599a00c71c48eb87452d8f52150c01'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.870446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1599a00c71c48eb87452d8f52150c01'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.881998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1599a00c71c48eb87452d8f52150c01'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.895581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1599a00c71c48eb87452d8f52150c01'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.896394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-29188b08-6134-486d-a4b5-1fa08a72955c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1599a00c71c48eb87452d8f52150c01'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:38.909786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 832/1661] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:38.910031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 830/1662] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:38 2022] DELETE /identity/v3/users/b1599a00c71c48eb87452d8f52150c01 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:38.910031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:38.910031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:38.913203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:38.919707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:38.932657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:38.944963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:38.946358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.001675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac2e6c-e4a7-42a1-b119-e1d3767b764f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:39.060652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 831/1663] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:39.063114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:39.070499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.120086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a03cf8-6c59-4135-9cdb-dd17df070c04 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:39.136711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:39.137771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:39.138264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:39.138728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] PATH_INFO: `/v3/projects/398e1e5b32054988a0c290d0e49cd87b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:39.144609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=398e1e5b32054988a0c290d0e49cd87b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:39.152148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:39.246312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:39.247822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:39.248770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:39.249405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] PATH_INFO: `/v3/users/8c9552c320544c0296c8f65221bc6e07` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:39.254197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398e1e5b32054988a0c290d0e49cd87b', 'request_id': 'req-6f0c13b3-38c0-475c-baba-8ca13da12089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.256524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9552c320544c0296c8f65221bc6e07)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:39.257784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:39.263438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:39.270787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398e1e5b32054988a0c290d0e49cd87b', 'request_id': 'req-6f0c13b3-38c0-475c-baba-8ca13da12089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.281910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398e1e5b32054988a0c290d0e49cd87b', 'request_id': 'req-6f0c13b3-38c0-475c-baba-8ca13da12089'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.298656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] The token cache is being invalidate because project 398e1e5b32054988a0c290d0e49cd87b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:39.298990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.299847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f0c13b3-38c0-475c-baba-8ca13da12089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.302926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 832/1664] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:39 2022] DELETE /identity/v3/projects/398e1e5b32054988a0c290d0e49cd87b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:39.304374 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:39.304658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:39.304930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:39.320505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:39.350917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:39.354337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.461565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9552c320544c0296c8f65221bc6e07'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.482440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 833/1665] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:39.491620 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:39.496503 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.525981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9552c320544c0296c8f65221bc6e07'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.551812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9552c320544c0296c8f65221bc6e07'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.563085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9552c320544c0296c8f65221bc6e07'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.584994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9552c320544c0296c8f65221bc6e07'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:39.609180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 833/1666] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:38 2022] DELETE /identity/v3/users/8c9552c320544c0296c8f65221bc6e07 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:39.613030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:39.619548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.757188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2173-a18d-4671-94c0-4086bfc17cc8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:39.817086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac8046-98cb-4282-8118-8c312598c52f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:39.832949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068ef4-4ebd-47cf-8cdd-e76e00d1ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:39.833694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068ef4-4ebd-47cf-8cdd-e76e00d1ecee admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:39.833872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068ef4-4ebd-47cf-8cdd-e76e00d1ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:39.834131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068ef4-4ebd-47cf-8cdd-e76e00d1ecee admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:39.834845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068ef4-4ebd-47cf-8cdd-e76e00d1ecee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:39.835150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068ef4-4ebd-47cf-8cdd-e76e00d1ecee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:39.836804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068ef4-4ebd-47cf-8cdd-e76e00d1ecee admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:39.874481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 834/1667] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:39.876736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:39.877025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:39.877308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:39.924925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:39.926165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.932389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7adf66-46e6-4aee-99a9-f7ecca7c1d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:39.933020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7adf66-46e6-4aee-99a9-f7ecca7c1d2c service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:39.933304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7adf66-46e6-4aee-99a9-f7ecca7c1d2c service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:39.933573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7adf66-46e6-4aee-99a9-f7ecca7c1d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:39.937732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4a7adf66-46e6-4aee-99a9-f7ecca7c1d2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.948994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 835/1668] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:39.949976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:39.955432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:39.991699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:40.172675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7adf66-46e6-4aee-99a9-f7ecca7c1d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:40.178175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7adf66-46e6-4aee-99a9-f7ecca7c1d2c service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:40.198759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaef46c-2dc7-485a-af53-ece5ffbfa6ee None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:40.210008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 834/1669] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:40.212152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81809-9aae-4a54-8d2e-d037d23a8741 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:40.212490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81809-9aae-4a54-8d2e-d037d23a8741 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:40.212719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81809-9aae-4a54-8d2e-d037d23a8741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:40.238073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c71bb4-4057-4b69-adf8-8c4d58bb822b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:40.240281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a0d81809-9aae-4a54-8d2e-d037d23a8741 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:40.243111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a0d81809-9aae-4a54-8d2e-d037d23a8741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:40.244086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71bb4-4057-4b69-adf8-8c4d58bb822b service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:40.248124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71bb4-4057-4b69-adf8-8c4d58bb822b service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:40.250565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c71bb4-4057-4b69-adf8-8c4d58bb822b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:40.259563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-05c71bb4-4057-4b69-adf8-8c4d58bb822b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:40.259957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 835/1670] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:40.262542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d81809-9aae-4a54-8d2e-d037d23a8741 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:40.306374 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d81809-9aae-4a54-8d2e-d037d23a8741 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:40.321449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:40.322504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:40.322994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:40.323463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:40.324689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:40.329252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:40.362827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c71bb4-4057-4b69-adf8-8c4d58bb822b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:40.368412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c71bb4-4057-4b69-adf8-8c4d58bb822b service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:40.437806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 836/1671] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:40.441936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92d74-ae2a-4820-b456-1fc807496284 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:40.445562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92d74-ae2a-4820-b456-1fc807496284 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:40.446967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92d74-ae2a-4820-b456-1fc807496284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:40.477510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 836/1672] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:40 2022] POST /identity/v3/projects => generated 405 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:40.479034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:40.568582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0ec92d74-ae2a-4820-b456-1fc807496284 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:40.574489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0ec92d74-ae2a-4820-b456-1fc807496284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:40.649137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:40.844286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1619e1f-ab4a-460c-950b-b09818c8dfba admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:40.868857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:40.869504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:40.869827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:40.870085 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:40.897814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 837/1673] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:40.898625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92d74-ae2a-4820-b456-1fc807496284 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:40.925269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:40.927526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:40.950293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92d74-ae2a-4820-b456-1fc807496284 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:40.981686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:40.997795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:40.998294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.000902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.001594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 837/1674] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:41.003515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.004914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.012578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.042741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d7b76-9cbe-49db-91a1-44f1dfda7875 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.055082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.056116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.056116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.056408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.057068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:41.059654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.063312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.075463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 838/1675] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:40 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:41.078130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.085163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:41.097925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 838/1676] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:41.098886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.128727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bce55-1321-4af7-8bf3-c5783f1badf0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.139460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.145571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.145881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.146163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.151061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.156179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.184870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 839/1677] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:41.186735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.217052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27249312-271c-4fc9-a810-d60bed0adeef admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.231454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.232494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.233757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.233757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.233757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.239336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.300199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 840/1678] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:41 2022] POST /identity/v3/projects => generated 407 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:41.301520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.301811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd216-7b2d-4b36-9ec4-13080fb14b87 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.388283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:41.418338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc4e7-dced-4009-b352-e708b0cdbba7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.425625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.426905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.427274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.427936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.429561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.433165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.452972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 841/1679] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:41.452972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.466365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.466609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.466843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.467189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.471701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:41.492733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7384-e54f-49a6-924f-74f59838bd74 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.521385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.522645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.524351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.524964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.525064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.526773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.534626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.536705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.586777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 839/1680] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:41.588247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.610384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 842/1681] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:41 2022] POST /identity/v3/users => generated 304 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:41.611568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.633634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828463b-e18f-4a7d-8043-1c96ba247a3e service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.640756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb5a98-2271-4c35-b521-41646dfd54d4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.651812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cda27-7a44-4bb2-8e4a-92f27b7df748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.655169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cda27-7a44-4bb2-8e4a-92f27b7df748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.659267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cda27-7a44-4bb2-8e4a-92f27b7df748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.660049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cda27-7a44-4bb2-8e4a-92f27b7df748 admin admin] PATH_INFO: `/v3/projects/89f7337274684536886f5900872c8ed5/users/1092a4f0277b4b189e1af17152b4e54a/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.664668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.665344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.665630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.665903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.666633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.673399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.692426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 843/1682] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:41.693435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.705615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f16c08-f8e6-427b-bda6-096e89bc72dc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.711132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:41.711863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.712213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.712707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:41.713440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.715192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.741686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 844/1683] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:41.759282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:41.784347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cda27-7a44-4bb2-8e4a-92f27b7df748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f7337274684536886f5900872c8ed5, user_id=1092a4f0277b4b189e1af17152b4e54a, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:41.789908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cda27-7a44-4bb2-8e4a-92f27b7df748 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:41.845545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57dcf-9e7b-4f23-b1ca-43f9fbbb3295 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:41.870383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 840/1684] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:41 2022] PUT /identity/v3/projects/89f7337274684536886f5900872c8ed5/users/1092a4f0277b4b189e1af17152b4e54a/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:41.893609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953ab1-f2a5-4bab-b388-2caab7fe80a1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:41.894784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953ab1-f2a5-4bab-b388-2caab7fe80a1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:41.894784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953ab1-f2a5-4bab-b388-2caab7fe80a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.028468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:42.077062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-60953ab1-f2a5-4bab-b388-2caab7fe80a1 None None] MFA Rules not processed for user `1092a4f0277b4b189e1af17152b4e54a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.079583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-60953ab1-f2a5-4bab-b388-2caab7fe80a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:42.245334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e0104-2e4e-4701-aef0-84337557e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.250979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0104-2e4e-4701-aef0-84337557e00a admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.251432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0104-2e4e-4701-aef0-84337557e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.251885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e0104-2e4e-4701-aef0-84337557e00a admin admin] PATH_INFO: `/v3/projects/35281db69a3645feb85c64adc90d51f3/users/3231601a3f5b4e2b81be0b5d0715e040/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.373095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 841/1685] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:42.379961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953ab1-f2a5-4bab-b388-2caab7fe80a1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.381306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e0104-2e4e-4701-aef0-84337557e00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35281db69a3645feb85c64adc90d51f3, user_id=3231601a3f5b4e2b81be0b5d0715e040, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.412170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e0104-2e4e-4701-aef0-84337557e00a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.422501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953ab1-f2a5-4bab-b388-2caab7fe80a1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:42.448243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:42.449514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.449977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.453282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.455426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:42.465920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:42.471680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 845/1686] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:41 2022] PUT /identity/v3/projects/35281db69a3645feb85c64adc90d51f3/users/3231601a3f5b4e2b81be0b5d0715e040/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:42.490472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7d7d-20a3-4307-9898-e982b77fe585 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:42.490927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7d7d-20a3-4307-9898-e982b77fe585 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:42.491368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7d7d-20a3-4307-9898-e982b77fe585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:42.593467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 842/1687] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/projects => generated 405 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:42.600018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:42.695051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-dbcd7d7d-20a3-4307-9898-e982b77fe585 None None] MFA Rules not processed for user `3231601a3f5b4e2b81be0b5d0715e040`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:42.702585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-dbcd7d7d-20a3-4307-9898-e982b77fe585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.007407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c6de5-f50b-4035-9632-c521f469fc18 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.047992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.049022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.049525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.050145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.058780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 846/1688] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 570 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:43.060090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.061179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd7d7d-20a3-4307-9898-e982b77fe585 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.073171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.135993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd7d7d-20a3-4307-9898-e982b77fe585 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.172343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 843/1689] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:42 2022] POST /identity/v3/users => generated 309 bytes in 573 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:15:43.176612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.177568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.177874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.184263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.184876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.187346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.191041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.245665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f65470-37aa-4a5e-a789-bd80551cb01b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.269952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:43.290196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.291575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.293827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.295024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.300470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.306046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.354314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 844/1690] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:43.357621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 847/1691] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/projects => generated 409 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.359709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.364121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.400385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a2e0d-c5d7-4fbc-babf-719aec54e595 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.572850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72a5a7-4004-4551-b0cb-a3d4d39b1711 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.575067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:43.609932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6564501-5b62-4445-8be0-c7ee6022fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.610687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564501-5b62-4445-8be0-c7ee6022fbb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.610975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564501-5b62-4445-8be0-c7ee6022fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.611254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6564501-5b62-4445-8be0-c7ee6022fbb5 admin admin] PATH_INFO: `/v3/projects/c6aed332a98543c5bc28dae3609e8b73/users/aa68128001c84b0e9b3186528e7c3510/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.612841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.613472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.613746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.614197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.615081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.617075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.669143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564501-5b62-4445-8be0-c7ee6022fbb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6aed332a98543c5bc28dae3609e8b73, user_id=aa68128001c84b0e9b3186528e7c3510, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.672384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6564501-5b62-4445-8be0-c7ee6022fbb5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:43.691730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 845/1692] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/users => generated 311 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:43.693000 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:43.697907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.729277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 848/1693] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:43 2022] PUT /identity/v3/projects/c6aed332a98543c5bc28dae3609e8b73/users/aa68128001c84b0e9b3186528e7c3510/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:43.730423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378862e0-5062-497b-8e38-3a122e0d02e9 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.730723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378862e0-5062-497b-8e38-3a122e0d02e9 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.730996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378862e0-5062-497b-8e38-3a122e0d02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.794579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3095c0-96e2-4f3f-b4e5-af955ccd5065 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:43.807402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-378862e0-5062-497b-8e38-3a122e0d02e9 None None] MFA Rules not processed for user `2bc03f8cc95c4f2da66897f3150e7efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:43.808716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-378862e0-5062-497b-8e38-3a122e0d02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:43.961650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:43.963383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:43.963986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:43.964365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] PATH_INFO: `/v3/projects/bfa00173a09c4dcfb47f59906ee3ad45` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:43.968505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa00173a09c4dcfb47f59906ee3ad45)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:43.970945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.019959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 849/1694] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:44.021270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378862e0-5062-497b-8e38-3a122e0d02e9 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.061510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378862e0-5062-497b-8e38-3a122e0d02e9 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.088463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa00173a09c4dcfb47f59906ee3ad45', 'request_id': 'req-eb04487f-f29e-484c-a72f-0487026e4037'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.111120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa00173a09c4dcfb47f59906ee3ad45', 'request_id': 'req-eb04487f-f29e-484c-a72f-0487026e4037'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.128726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa00173a09c4dcfb47f59906ee3ad45', 'request_id': 'req-eb04487f-f29e-484c-a72f-0487026e4037'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.173910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] The token cache is being invalidate because project bfa00173a09c4dcfb47f59906ee3ad45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:44.174472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.177938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.182858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 846/1695] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:43 2022] DELETE /identity/v3/projects/bfa00173a09c4dcfb47f59906ee3ad45 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:44.185229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.192562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:44.318126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c8a36-6bc8-4319-95e4-77dcc03af3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.321159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8a36-6bc8-4319-95e4-77dcc03af3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.322656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8a36-6bc8-4319-95e4-77dcc03af3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.323424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c8a36-6bc8-4319-95e4-77dcc03af3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.329074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8a36-6bc8-4319-95e4-77dcc03af3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.340435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c8a36-6bc8-4319-95e4-77dcc03af3b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.372995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:44.444307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04487f-f29e-484c-a72f-0487026e4037 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.448250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 850/1696] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:44.471407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.473842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.474329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.474981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.475743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.476347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.479545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.479545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.484325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.535229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] MFA Rules not processed for user `2bc03f8cc95c4f2da66897f3150e7efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:44.537282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:44.549288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 847/1697] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:44.549288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.560004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:44.617351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77696e15-7af4-461d-b69f-772308490dfb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.634954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.635622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.635902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.636178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] PATH_INFO: `/v3/users/0e22854551ec465f9457200a0892679e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.640304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e22854551ec465f9457200a0892679e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.646988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:44.679374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:44.826811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e22854551ec465f9457200a0892679e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.861939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e22854551ec465f9457200a0892679e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.875996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 851/1698] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:44.877177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.879511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:44.899390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e22854551ec465f9457200a0892679e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.903950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e22854551ec465f9457200a0892679e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.918855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e22854551ec465f9457200a0892679e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:44.932924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15974a5d-7c9a-49d3-838a-5a5b444b9715 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:44.944582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 848/1699] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:44 2022] DELETE /identity/v3/users/0e22854551ec465f9457200a0892679e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:44.946770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:44.950451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:44.952277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:44.953348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:44.953678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:44.953960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] PATH_INFO: `/v3/projects/99d7c073d42b4d5c97b7bb67f58318b0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:44.956531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d7c073d42b4d5c97b7bb67f58318b0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:44.958987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.039358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d7c073d42b4d5c97b7bb67f58318b0', 'request_id': 'req-31c03065-7949-4c9e-af3f-b8e42ae694bb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:45.057208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d7c073d42b4d5c97b7bb67f58318b0', 'request_id': 'req-31c03065-7949-4c9e-af3f-b8e42ae694bb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:45.069610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d7c073d42b4d5c97b7bb67f58318b0', 'request_id': 'req-31c03065-7949-4c9e-af3f-b8e42ae694bb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:45.093335 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] The token cache is being invalidate because project 99d7c073d42b4d5c97b7bb67f58318b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:45.094083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:45.095252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:45.102621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 852/1700] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:44 2022] DELETE /identity/v3/projects/99d7c073d42b4d5c97b7bb67f58318b0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:45.104323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.108966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.274714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7286bb-db8c-4797-bfd0-bd1d20a30468 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.285033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.286184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.286870 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.300742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] PATH_INFO: `/v3/projects/002e6130cc0c490a8496b0b25aedcd67/users/44f06b07ba1b4b47b3c221958379cc0c/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.314197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c03065-7949-4c9e-af3f-b8e42ae694bb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.321771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d43dd-ea10-44c3-a7b6-2ed53a3a63aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.323135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d43dd-ea10-44c3-a7b6-2ed53a3a63aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.323609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d43dd-ea10-44c3-a7b6-2ed53a3a63aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.324035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d43dd-ea10-44c3-a7b6-2ed53a3a63aa admin admin] PATH_INFO: `/v3/projects/c6aed332a98543c5bc28dae3609e8b73/users/aa68128001c84b0e9b3186528e7c3510/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.328663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d43dd-ea10-44c3-a7b6-2ed53a3a63aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6aed332a98543c5bc28dae3609e8b73, user_id=aa68128001c84b0e9b3186528e7c3510, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.333556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d43dd-ea10-44c3-a7b6-2ed53a3a63aa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.349450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 853/1701] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:45 2022] PUT /identity/v3/projects/c6aed332a98543c5bc28dae3609e8b73/users/aa68128001c84b0e9b3186528e7c3510/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:45.362948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564f798-f518-4dcc-a1c2-5622a3d57a23 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.362948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564f798-f518-4dcc-a1c2-5622a3d57a23 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.364870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564f798-f518-4dcc-a1c2-5622a3d57a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.368692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] RBAC: Authorizing `identity:create_grant(project_id=002e6130cc0c490a8496b0b25aedcd67, user_id=44f06b07ba1b4b47b3c221958379cc0c, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.379644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.434705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c564f798-f518-4dcc-a1c2-5622a3d57a23 None None] MFA Rules not processed for user `98fc7b08006741ae9b0a217ce7fe8c92`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:45.438994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c564f798-f518-4dcc-a1c2-5622a3d57a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.439190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 849/1702] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:44 2022] PUT /identity/v3/projects/002e6130cc0c490a8496b0b25aedcd67/users/44f06b07ba1b4b47b3c221958379cc0c/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:45.439190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.448666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.469266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.683801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8d94-18e0-4638-9148-dd858f87d22f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:45.690419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 854/1703] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:45.699350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7227aee-83c1-482d-a375-241c1cc5f3fc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.700218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7227aee-83c1-482d-a375-241c1cc5f3fc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.703483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7227aee-83c1-482d-a375-241c1cc5f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.714894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:45.715553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.716116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.716402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.719299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.725569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:45.768513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f7227aee-83c1-482d-a375-241c1cc5f3fc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:45.769802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f7227aee-83c1-482d-a375-241c1cc5f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.861857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 855/1704] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:45.867742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:45.868072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:45.868319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:45.894300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:45.897685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:45.927515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] MFA Rules not processed for user `aa68128001c84b0e9b3186528e7c3510`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:45.929803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:45.937253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 850/1705] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:45.938947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:45.941653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:46.014502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9e08a-7662-4ca9-8053-a0f247f21ec2 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.040097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.041126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.041962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.044491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.046365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.051933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.088398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 851/1706] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:46.102297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.106748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:46.158938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0610d5-1785-4d3b-944e-00c9a87d3ac3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.188571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 856/1707] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:46.190543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.192486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:46.211496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.212992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.213703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.214424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] PATH_INFO: `/v3/projects/3edd71e4f7c947fab1e3318bdde02943` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.219858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edd71e4f7c947fab1e3318bdde02943)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.230015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b432-aaae-4cdb-918d-3d9baaa8066d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:46.231545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.257443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7308e1-a40f-4f42-ae22-156099272c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:46.258520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7308e1-a40f-4f42-ae22-156099272c3d service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.259024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7308e1-a40f-4f42-ae22-156099272c3d service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.259516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7308e1-a40f-4f42-ae22-156099272c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.301319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7308e1-a40f-4f42-ae22-156099272c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:46.304509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7308e1-a40f-4f42-ae22-156099272c3d service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:46.345221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 857/1708] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:46.352019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:46.352396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:46.352882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:46.425285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edd71e4f7c947fab1e3318bdde02943', 'request_id': 'req-1c205c64-93c0-417c-bb1c-c2e4ad440161'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:46.446164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:46.450068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edd71e4f7c947fab1e3318bdde02943', 'request_id': 'req-1c205c64-93c0-417c-bb1c-c2e4ad440161'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:46.454676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:46.473931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edd71e4f7c947fab1e3318bdde02943', 'request_id': 'req-1c205c64-93c0-417c-bb1c-c2e4ad440161'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:46.556066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:46.559714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] The token cache is being invalidate because project 3edd71e4f7c947fab1e3318bdde02943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:46.560235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:46.567557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:46.575800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 852/1709] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:46 2022] DELETE /identity/v3/projects/3edd71e4f7c947fab1e3318bdde02943 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:46.585502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.595296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:46.878859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 858/1710] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:46.880565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:46.892673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:46.999914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c205c64-93c0-417c-bb1c-c2e4ad440161 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.019089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ed6cb-606f-4783-82c4-fb554863f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.019835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed6cb-606f-4783-82c4-fb554863f2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.020161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed6cb-606f-4783-82c4-fb554863f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.020450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ed6cb-606f-4783-82c4-fb554863f2d2 admin admin] PATH_INFO: `/v3/projects/002e6130cc0c490a8496b0b25aedcd67/users/44f06b07ba1b4b47b3c221958379cc0c/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.023054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ed6cb-606f-4783-82c4-fb554863f2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002e6130cc0c490a8496b0b25aedcd67, user_id=44f06b07ba1b4b47b3c221958379cc0c, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.025857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ed6cb-606f-4783-82c4-fb554863f2d2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.054385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 853/1711] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:46 2022] PUT /identity/v3/projects/002e6130cc0c490a8496b0b25aedcd67/users/44f06b07ba1b4b47b3c221958379cc0c/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:47.054385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc75e1-d592-48dd-a799-ecd6dc08b20c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.054385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc75e1-d592-48dd-a799-ecd6dc08b20c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.054385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc75e1-d592-48dd-a799-ecd6dc08b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.135034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e0bc75e1-d592-48dd-a799-ecd6dc08b20c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.137763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e0bc75e1-d592-48dd-a799-ecd6dc08b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.146047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d8ea5-39e6-43de-8aa6-89c448aa0be8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.151330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.314537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f372a-1846-4671-bf4f-7a933734b1ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.315792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f372a-1846-4671-bf4f-7a933734b1ed service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.316331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f372a-1846-4671-bf4f-7a933734b1ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.316758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f372a-1846-4671-bf4f-7a933734b1ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.319616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6b9f372a-1846-4671-bf4f-7a933734b1ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.329803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 854/1712] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.331648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044127e-535f-4ab8-9617-4f27aa1ea5ae None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.332236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044127e-535f-4ab8-9617-4f27aa1ea5ae None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.333218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044127e-535f-4ab8-9617-4f27aa1ea5ae None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.335797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 855/1713] 10.222.0.36 () {54 vars in 912 bytes} [Thu Sep 1 08:15:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:15:47.336923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044127e-535f-4ab8-9617-4f27aa1ea5ae None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.355048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044127e-535f-4ab8-9617-4f27aa1ea5ae None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.362399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef5940-62aa-40fc-a861-790d28a09c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.364095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef5940-62aa-40fc-a861-790d28a09c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.364896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef5940-62aa-40fc-a861-790d28a09c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.365520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef5940-62aa-40fc-a861-790d28a09c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.366719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef5940-62aa-40fc-a861-790d28a09c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:47.369641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef5940-62aa-40fc-a861-790d28a09c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.372483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef5940-62aa-40fc-a861-790d28a09c59 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.410112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 856/1714] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:47.410112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62666a7-f1b8-4f36-a3b3-07aabba3e574 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.410112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62666a7-f1b8-4f36-a3b3-07aabba3e574 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.410112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62666a7-f1b8-4f36-a3b3-07aabba3e574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.432245 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f372a-1846-4671-bf4f-7a933734b1ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.439051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f372a-1846-4671-bf4f-7a933734b1ed service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:47.460100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c62666a7-f1b8-4f36-a3b3-07aabba3e574 None None] MFA Rules not processed for user `44f06b07ba1b4b47b3c221958379cc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.461441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c62666a7-f1b8-4f36-a3b3-07aabba3e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.481575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 859/1715] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:47.485703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20aad-03b4-4d76-a6ad-430f6a971741 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.487089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20aad-03b4-4d76-a6ad-430f6a971741 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.487784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20aad-03b4-4d76-a6ad-430f6a971741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.536121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-93e20aad-03b4-4d76-a6ad-430f6a971741 None None] MFA Rules not processed for user `93c8237bd14c40dda53daecb949a33ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.538399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-93e20aad-03b4-4d76-a6ad-430f6a971741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.630860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:47.691181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 857/1716] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.692540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda74082-92d7-46e7-aa7d-5ec2395692e6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.694533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda74082-92d7-46e7-aa7d-5ec2395692e6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.696448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda74082-92d7-46e7-aa7d-5ec2395692e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.715847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 860/1717] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.717993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a448141-fbf8-4019-a256-dabf3d7ec344 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.718305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a448141-fbf8-4019-a256-dabf3d7ec344 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.718586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a448141-fbf8-4019-a256-dabf3d7ec344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.793035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2a448141-fbf8-4019-a256-dabf3d7ec344 None None] MFA Rules not processed for user `43048122a82e4562babb240ff090d5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.800091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2a448141-fbf8-4019-a256-dabf3d7ec344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.840183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dda74082-92d7-46e7-aa7d-5ec2395692e6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:47.845004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dda74082-92d7-46e7-aa7d-5ec2395692e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:47.899679 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 858/1718] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:47.912170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda74082-92d7-46e7-aa7d-5ec2395692e6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:47.949204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda74082-92d7-46e7-aa7d-5ec2395692e6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:47.958886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:47.959884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:47.961151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:47.961565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:47.966866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:47.973192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.042632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 861/1719] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:48.047400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a448141-fbf8-4019-a256-dabf3d7ec344 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.060137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a448141-fbf8-4019-a256-dabf3d7ec344 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.062321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 859/1720] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:47 2022] POST /identity/v3/projects => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:48.067184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.067184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:48.133976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.135074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.135468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.135844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.272158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.273806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.298317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 862/1721] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:48.303616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.368412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:48.406712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:48.410112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3950db-1af8-4b59-bb66-834caa638da5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.425250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.426416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.427007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.427473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] PATH_INFO: `/v3/users/1092a4f0277b4b189e1af17152b4e54a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.430630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1092a4f0277b4b189e1af17152b4e54a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.441423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.508426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6455b-8fad-43bd-96e8-6355109cefc8 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.529052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.529885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.530406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.530700 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.531396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:48.531702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.533447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.575507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 863/1722] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:48.575507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.599054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c59be-2d56-4558-baa5-1edfb9d1464d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.618781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.619454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.619714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.619975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.620635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.622734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:48.639702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1092a4f0277b4b189e1af17152b4e54a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:48.687981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 864/1723] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:48 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:48.687981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.694855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:48.713928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1092a4f0277b4b189e1af17152b4e54a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:48.731045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1092a4f0277b4b189e1af17152b4e54a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:48.732449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1092a4f0277b4b189e1af17152b4e54a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:48.773522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1092a4f0277b4b189e1af17152b4e54a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:48.791659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 860/1724] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:48 2022] DELETE /identity/v3/users/1092a4f0277b4b189e1af17152b4e54a => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:48.794076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:48.798103 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:48.948940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4f43e-442e-429b-98c0-2987d0223057 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.970365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa45984-1bd9-4f26-8a4c-81a5f032936d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:48.979545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:48.980809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:48.981097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:48.981366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:48.982702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:48.985450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.040296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 861/1725] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:48 2022] POST /identity/v3/projects => generated 365 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:49.041986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.049612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.098113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24e32b-85fa-4205-ae60-035cc259c727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.098952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24e32b-85fa-4205-ae60-035cc259c727 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.100000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24e32b-85fa-4205-ae60-035cc259c727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.101639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24e32b-85fa-4205-ae60-035cc259c727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.106176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ad24e32b-85fa-4205-ae60-035cc259c727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.123362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24e32b-85fa-4205-ae60-035cc259c727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.126193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24e32b-85fa-4205-ae60-035cc259c727 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.158230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 865/1726] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:49.159916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.162157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.162356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.199722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:49.202798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.220321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 866/1727] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:49.221763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.223796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.236952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363fc6c-ff69-4d17-98c0-29c45b0a8e31 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.245626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.247057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.247545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.248033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.249414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.254530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.257547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:49.287662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 862/1728] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:49.287662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.307299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0ade8-6032-421f-9d18-174bf4267dcc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.315802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.317223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.317729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.318225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.319469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.323432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.329155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b05590-79be-4129-960a-ac32dce8ad08 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.336014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.337636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.338824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.339343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.345854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.382613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:49.386690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 863/1729] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:49 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:49.389519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.392372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.480489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.482265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.493309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 867/1730] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:49 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:49.493554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ed2b2-c400-4cf3-a4d4-dd68160f266c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.494311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.508465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e57cf7-1345-486b-b542-558abcb90000 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.513102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.513642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.514555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.514818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.525706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.526363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.526645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.526915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.527582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.531841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.536401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.537877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.555792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 868/1731] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:49.556512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.568832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 864/1732] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:49.569739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.583068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175680f-9b1a-412a-a74d-b4d5a0757241 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.589391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f3c82-d030-4c67-a66c-59f8d19a9c73 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.595375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.595695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.601391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.601391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.601391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.601391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.609289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5068af-1c23-462f-96cd-b69bf11f5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.610176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5068af-1c23-462f-96cd-b69bf11f5822 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.610367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5068af-1c23-462f-96cd-b69bf11f5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.610550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5068af-1c23-462f-96cd-b69bf11f5822 admin admin] PATH_INFO: `/v3/projects/90953bf371c34f5b9bca60333a49d514/users/c9359429165a405e890e96c0065304d2/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.628826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 869/1733] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:49.629898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.646949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2e308-39bb-4600-910f-a951e1fad78b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.649565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5068af-1c23-462f-96cd-b69bf11f5822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90953bf371c34f5b9bca60333a49d514, user_id=c9359429165a405e890e96c0065304d2, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.655027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5068af-1c23-462f-96cd-b69bf11f5822 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.663032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.663996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.664315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.664769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.665588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.667324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:49.683641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 865/1734] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:49 2022] PUT /identity/v3/projects/90953bf371c34f5b9bca60333a49d514/users/c9359429165a405e890e96c0065304d2/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:49.691999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 870/1735] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:49.697880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813038b9-39f2-41c7-9c8f-ad1ba8a7dfd3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.697880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813038b9-39f2-41c7-9c8f-ad1ba8a7dfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.697880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813038b9-39f2-41c7-9c8f-ad1ba8a7dfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.698965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:49.712687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b4bd8b-81c7-4d54-aa61-1d6158d0858b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:49.776512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-813038b9-39f2-41c7-9c8f-ad1ba8a7dfd3 None None] MFA Rules not processed for user `c9359429165a405e890e96c0065304d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:49.779513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-813038b9-39f2-41c7-9c8f-ad1ba8a7dfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:49.846179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40a40a-b0f8-4524-875d-773afe4b28a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:49.846995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a40a-b0f8-4524-875d-773afe4b28a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:49.849774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a40a-b0f8-4524-875d-773afe4b28a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:49.850130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40a40a-b0f8-4524-875d-773afe4b28a7 admin admin] PATH_INFO: `/v3/projects/a4bfba90c76d471183f41843ffc12b07/users/0ae24f2065104371a8ae241f0c8c5844/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:49.938672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40a40a-b0f8-4524-875d-773afe4b28a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bfba90c76d471183f41843ffc12b07, user_id=0ae24f2065104371a8ae241f0c8c5844, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:49.945674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40a40a-b0f8-4524-875d-773afe4b28a7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.001574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 871/1736] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:49 2022] PUT /identity/v3/projects/a4bfba90c76d471183f41843ffc12b07/users/0ae24f2065104371a8ae241f0c8c5844/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:50.014471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb36ad-54c2-404d-8378-46fb4e37ceb0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.015156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb36ad-54c2-404d-8378-46fb4e37ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.015305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb36ad-54c2-404d-8378-46fb4e37ceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.064124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 866/1737] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:50.069499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813038b9-39f2-41c7-9c8f-ad1ba8a7dfd3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.085617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fccb36ad-54c2-404d-8378-46fb4e37ceb0 None None] MFA Rules not processed for user `0ae24f2065104371a8ae241f0c8c5844`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:50.089536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fccb36ad-54c2-404d-8378-46fb4e37ceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:50.128123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813038b9-39f2-41c7-9c8f-ad1ba8a7dfd3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.400180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:50.425998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:50.447288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.447825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.448105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.448380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.449466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:50.461354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.465702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 872/1738] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:50.487766 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb36ad-54c2-404d-8378-46fb4e37ceb0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.526770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb36ad-54c2-404d-8378-46fb4e37ceb0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.533783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.534463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.534810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.535080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.536001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:50.538626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.583018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 867/1739] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:50 2022] POST /identity/v3/projects => generated 369 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:50.590391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.628095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 873/1740] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:50 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:50.633214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.811996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c9bd-de1d-402d-88a9-7516adc3ef40 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.831424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e93c60-1fbc-419c-a853-19684bdf3b61 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.837095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.847511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.847868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.849460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.850993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.851636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:50.851796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.851961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.852214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.852995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:50.858641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.859524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:50.928547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 868/1741] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:50 2022] POST /identity/v3/users => generated 291 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:50.931456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.939136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:50.954105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 874/1742] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:50 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:50.963495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:50.966646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304f04-9f5d-4d3e-ab23-78726919b318 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.990133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:50.992618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:50.993793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:50.994122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] PATH_INFO: `/v3/projects/89f7337274684536886f5900872c8ed5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:50.996584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84c397-5d1c-4ad1-b9a2-3b848d9f0be6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:50.998332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f7337274684536886f5900872c8ed5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.003931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.022650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.023396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.023696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.024106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.024789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.030323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.066373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 875/1743] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:51.066373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.117697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c649e-896a-4932-8aaf-c2deafc8ac4e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.140752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.148349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.148671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.148956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.150466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.152298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.184151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f7337274684536886f5900872c8ed5', 'request_id': 'req-3c117b12-f44f-42f4-96ac-5377dd92f1b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:51.202116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f7337274684536886f5900872c8ed5', 'request_id': 'req-3c117b12-f44f-42f4-96ac-5377dd92f1b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:51.218364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f7337274684536886f5900872c8ed5', 'request_id': 'req-3c117b12-f44f-42f4-96ac-5377dd92f1b0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:51.235208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 876/1744] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:51.236706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.237032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] The token cache is being invalidate because project 89f7337274684536886f5900872c8ed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:51.237960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:51.238993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:51.241276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 869/1745] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:50 2022] DELETE /identity/v3/projects/89f7337274684536886f5900872c8ed5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:51.242525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.244219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:51.280919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c5c54-e361-4926-824f-2ba89f3a7c66 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.466282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:51.501353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.507600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.510096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.510576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] PATH_INFO: `/v3/projects/2b92ff267625431da80fa2bd129b227d/users/2750c3311b674103b52d5245933ef971/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.559457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c117b12-f44f-42f4-96ac-5377dd92f1b0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.593061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.594552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.595213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.597078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] PATH_INFO: `/v3/projects/d989b083e0c247c385192feb6376fb64/users/550e50c7f8dc4eec9130cccd0d5104c3/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:51.614046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b92ff267625431da80fa2bd129b227d, user_id=2750c3311b674103b52d5245933ef971, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.626349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.676459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 877/1746] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:51 2022] PUT /identity/v3/projects/2b92ff267625431da80fa2bd129b227d/users/2750c3311b674103b52d5245933ef971/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:51.679855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.688034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:51.698383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d989b083e0c247c385192feb6376fb64, user_id=550e50c7f8dc4eec9130cccd0d5104c3, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:51.705558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:51.758609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 870/1747] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:51 2022] PUT /identity/v3/projects/d989b083e0c247c385192feb6376fb64/users/550e50c7f8dc4eec9130cccd0d5104c3/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:51.759844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:51.762788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:51.919099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:51.969887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56308bf-df32-4263-ac65-325696dca5bc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:51.992919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:51.997180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:51.997720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:51.999223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.004308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:52.012427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.072284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 871/1748] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:52.074298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:52.104952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1ea15-5deb-4b42-8922-26cee6c390a4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:52.117262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:52.118215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.119811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.120829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] PATH_INFO: `/v3/users/aa68128001c84b0e9b3186528e7c3510` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.127164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa68128001c84b0e9b3186528e7c3510)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:52.129117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012423e-4730-4b7b-9988-617e63b33b7c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:52.135899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.165111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:52.169731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.173288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.174235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.181128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:52.195446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.237308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 872/1749] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:52.238088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:52.269853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea957d5e-61ba-460d-8f70-ca92c0f9312d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:52.276369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:52.276816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.277100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.277524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] PATH_INFO: `/v3/projects/2b92ff267625431da80fa2bd129b227d/users/2750c3311b674103b52d5245933ef971/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.284705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b92ff267625431da80fa2bd129b227d, user_id=2750c3311b674103b52d5245933ef971, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:52.287674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.319056 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 873/1750] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:52 2022] PUT /identity/v3/projects/2b92ff267625431da80fa2bd129b227d/users/2750c3311b674103b52d5245933ef971/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:52.319940 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:52.351273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa68128001c84b0e9b3186528e7c3510'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:52.411366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa68128001c84b0e9b3186528e7c3510'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:52.469359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa68128001c84b0e9b3186528e7c3510'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:52.474371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53bd96-5fc6-4c48-93fc-576c93cb60cf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:52.495879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069c102-9ce3-4764-8528-1a937e4c8186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:52.498770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069c102-9ce3-4764-8528-1a937e4c8186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.501188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069c102-9ce3-4764-8528-1a937e4c8186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.501584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069c102-9ce3-4764-8528-1a937e4c8186 admin admin] PATH_INFO: `/v3/projects/d989b083e0c247c385192feb6376fb64/users/550e50c7f8dc4eec9130cccd0d5104c3/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.518796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa68128001c84b0e9b3186528e7c3510'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:52.520609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069c102-9ce3-4764-8528-1a937e4c8186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d989b083e0c247c385192feb6376fb64, user_id=550e50c7f8dc4eec9130cccd0d5104c3, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:52.526715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2185d983-a290-4d99-843a-b91c39f6c402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa68128001c84b0e9b3186528e7c3510'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:52.534863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069c102-9ce3-4764-8528-1a937e4c8186 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:52.562047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 878/1751] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:51 2022] DELETE /identity/v3/users/aa68128001c84b0e9b3186528e7c3510 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:52.577025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365e36-2937-45e6-bf5c-3b3a43c1549d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.577528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365e36-2937-45e6-bf5c-3b3a43c1549d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.578019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365e36-2937-45e6-bf5c-3b3a43c1549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.612978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 874/1752] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:52 2022] PUT /identity/v3/projects/d989b083e0c247c385192feb6376fb64/users/550e50c7f8dc4eec9130cccd0d5104c3/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:52.629786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dd9d4-ae85-4f05-8061-5be37b6a0d27 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.630271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dd9d4-ae85-4f05-8061-5be37b6a0d27 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.644964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027dd9d4-ae85-4f05-8061-5be37b6a0d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:52.737594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-de365e36-2937-45e6-bf5c-3b3a43c1549d None None] MFA Rules not processed for user `2750c3311b674103b52d5245933ef971`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:52.740045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-de365e36-2937-45e6-bf5c-3b3a43c1549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:52.755290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-027dd9d4-ae85-4f05-8061-5be37b6a0d27 None None] MFA Rules not processed for user `550e50c7f8dc4eec9130cccd0d5104c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:52.757869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-027dd9d4-ae85-4f05-8061-5be37b6a0d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:52.822534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:52.986693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 875/1753] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:52.986693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:52.986693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:52.986693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.035511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 879/1754] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:53.039195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.040023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.042830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.056196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] MFA Rules not processed for user `98fc7b08006741ae9b0a217ce7fe8c92`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:53.065077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.148607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] MFA Rules not processed for user `2bc03f8cc95c4f2da66897f3150e7efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:53.156004 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.257491 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:53.322668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 876/1755] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:53.333858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:53.336320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.349703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 880/1756] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:53.351419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:53.359973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.555023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714cb54a-2281-4e20-a154-88fa8ef744f3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:53.556425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc1548-6ccd-488a-aadd-539f917ee5f0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:53.563375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:53.564520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.564634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:53.565403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.565726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.566087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.566286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.566769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.584316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:53.587011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:53.609876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 881/1757] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:53.611914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:53.615076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.617458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:53.620795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:53.682299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 877/1758] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:53.754290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:53.765734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b82e-1966-4b78-bb6b-d00679a0c6ef service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:53.773188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:53.773862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.774149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.774619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] PATH_INFO: `/v3/projects/c6aed332a98543c5bc28dae3609e8b73` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.776747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6aed332a98543c5bc28dae3609e8b73)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:53.776956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f8cc9-36d6-4b4d-b641-72e0b25918d2 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:53.778977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:53.788640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039eb75-067f-40f3-8d25-0bd332d548d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:53.788640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039eb75-067f-40f3-8d25-0bd332d548d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.788960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039eb75-067f-40f3-8d25-0bd332d548d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.789078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039eb75-067f-40f3-8d25-0bd332d548d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:53.800676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a039eb75-067f-40f3-8d25-0bd332d548d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:53.889384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6aed332a98543c5bc28dae3609e8b73', 'request_id': 'req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.923180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6aed332a98543c5bc28dae3609e8b73', 'request_id': 'req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.934220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6aed332a98543c5bc28dae3609e8b73', 'request_id': 'req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.959261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] The token cache is being invalidate because project c6aed332a98543c5bc28dae3609e8b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:53.959571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.962160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b320316c-e79c-4b2f-adc0-a4c8ecbbda3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:53.972240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 882/1759] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:53 2022] DELETE /identity/v3/projects/c6aed332a98543c5bc28dae3609e8b73 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:53.973802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9475c-ecb9-4e82-ace2-77ff469320fd None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:53.974091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9475c-ecb9-4e82-ace2-77ff469320fd None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:53.974725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9475c-ecb9-4e82-ace2-77ff469320fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.012040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-65a9475c-ecb9-4e82-ace2-77ff469320fd None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:54.013511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-65a9475c-ecb9-4e82-ace2-77ff469320fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:54.019543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:54.067316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039eb75-067f-40f3-8d25-0bd332d548d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.072721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039eb75-067f-40f3-8d25-0bd332d548d5 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.112616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 878/1760] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:54.219631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 883/1761] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:54.228379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90600-d4cb-46de-8127-1ba06f08b983 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.228892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90600-d4cb-46de-8127-1ba06f08b983 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.229371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90600-d4cb-46de-8127-1ba06f08b983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.267783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:54.300909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bab90600-d4cb-46de-8127-1ba06f08b983 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:54.313843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bab90600-d4cb-46de-8127-1ba06f08b983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:54.337660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9475c-ecb9-4e82-ace2-77ff469320fd None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.350097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 879/1762] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:54.380780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9475c-ecb9-4e82-ace2-77ff469320fd None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.441189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.441840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.442111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.442430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.443124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:54.443430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.445572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.480329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 884/1763] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:54.486999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab90600-d4cb-46de-8127-1ba06f08b983 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.513837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab90600-d4cb-46de-8127-1ba06f08b983 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.535381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.536297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.536792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.537255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.540120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.543606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.634815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.642557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 880/1764] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:54 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:54.654557 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae542707-34ae-40eb-860b-0071a07c48db admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.798362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.799300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.799835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.800531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.801586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.805607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:54.869079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 885/1765] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:54 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:15:54.869282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:54.927657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3ea55-cad7-4dc9-9821-d124553d8b92 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:54.944675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:54.948976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:54.949173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:54.949441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:54.950167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:54.960611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:55.001373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 881/1766] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:55.005831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:55.048021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d2a86-2152-434f-8239-eee67555ef69 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:55.095525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e70c9c-71ba-4778-a670-ce97b97feb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:55.098908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70c9c-71ba-4778-a670-ce97b97feb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.099157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70c9c-71ba-4778-a670-ce97b97feb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.099446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e70c9c-71ba-4778-a670-ce97b97feb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.102162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70c9c-71ba-4778-a670-ce97b97feb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:55.107000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e70c9c-71ba-4778-a670-ce97b97feb4b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:55.160441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 886/1767] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:55.165687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:55.196469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363fda8-3549-410c-94c7-31e51656b23c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:55.211901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:55.212602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.212887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.213166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] PATH_INFO: `/v3/projects/45d9c07b19a747bfa17151361b83c61e/users/d76e0dceda8e450eb2a4c9e332fc6862/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.306695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d9c07b19a747bfa17151361b83c61e, user_id=d76e0dceda8e450eb2a4c9e332fc6862, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:55.317143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:55.378024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 882/1768] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:55 2022] PUT /identity/v3/projects/45d9c07b19a747bfa17151361b83c61e/users/d76e0dceda8e450eb2a4c9e332fc6862/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:55.396304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c662918-c054-4792-bd9b-ced541dc13ae None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.396716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c662918-c054-4792-bd9b-ced541dc13ae None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.397011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c662918-c054-4792-bd9b-ced541dc13ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.490537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3c662918-c054-4792-bd9b-ced541dc13ae None None] MFA Rules not processed for user `d76e0dceda8e450eb2a4c9e332fc6862`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:55.492285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3c662918-c054-4792-bd9b-ced541dc13ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:55.714354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 887/1769] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:55.720954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:55.960152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72998457-4bbf-42d2-b9a1-827e9ad8937e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:55.967579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:55.968416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:55.968784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:55.969295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:55.970602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:55.974126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.075823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 883/1770] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:15:55 2022] POST /identity/v3/projects => generated 381 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:15:56.077759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c662918-c054-4792-bd9b-ced541dc13ae None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.087095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:56.110404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c662918-c054-4792-bd9b-ced541dc13ae None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.189167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.192270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:56.300615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.302815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.303489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.304015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.305368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.309760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.378429 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 888/1771] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:15:56 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:15:56.379474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.407888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4a19f-8cab-49f9-944a-e0b482fa8845 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.419286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.421438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.422572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.423214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.424758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.430148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.472705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 889/1772] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:15:56.479460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.517468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557991d-914f-4eac-8f6e-c27934f3bc35 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.539082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.540301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.540815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.543611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] PATH_INFO: `/v3/users/0ae24f2065104371a8ae241f0c8c5844` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.547409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae24f2065104371a8ae241f0c8c5844)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.550159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.551839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15842ed-4de9-4dbd-b02c-0b7c5fe0fad8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:56.578017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:56.579743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.582265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.583602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] PATH_INFO: `/v3/projects/9af5b83876a24f7e94be19c60752f346/users/5da9b69db8094a4a837f8fbfaffa1fc8/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.670624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:56.676607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af5b83876a24f7e94be19c60752f346, user_id=5da9b69db8094a4a837f8fbfaffa1fc8, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:56.686909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:56.732065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae24f2065104371a8ae241f0c8c5844'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:56.734698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 890/1773] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:56 2022] PUT /identity/v3/projects/9af5b83876a24f7e94be19c60752f346/users/5da9b69db8094a4a837f8fbfaffa1fc8/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:56.740076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:56.792749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae24f2065104371a8ae241f0c8c5844'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:56.818346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae24f2065104371a8ae241f0c8c5844'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:56.819945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae24f2065104371a8ae241f0c8c5844'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:56.847269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-93e0eb21-4bc2-4554-b45f-10e40f67003a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae24f2065104371a8ae241f0c8c5844'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:56.866750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 884/1774] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:56 2022] DELETE /identity/v3/users/0ae24f2065104371a8ae241f0c8c5844 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:56.871778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:56.872383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:56.873025 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:56.926811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:56.944076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.065525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759db6cc-6f77-4918-9df6-763db01de2d0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:57.126386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 885/1775] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:15:57.155312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:57.165609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.258431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:57.260017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:57.260740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:57.261413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:57.263084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:57.269552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:57.309958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 891/1776] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 572 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:15:57.317858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:57.324802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.337370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:57.352806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117ed10-0cf8-4367-b777-5a08c4c74393 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:57.361514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6298ad2-ae27-4740-a1f7-b82e69b11d21 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:57.377539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:57.377864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff7cc4-5bf3-4465-8366-a12a159c8ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:57.378762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff7cc4-5bf3-4465-8366-a12a159c8ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:57.379159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff7cc4-5bf3-4465-8366-a12a159c8ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:57.379587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff7cc4-5bf3-4465-8366-a12a159c8ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:57.380864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:57.381383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:57.381884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] PATH_INFO: `/v3/projects/9af5b83876a24f7e94be19c60752f346/users/5da9b69db8094a4a837f8fbfaffa1fc8/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:57.393752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff7cc4-5bf3-4465-8366-a12a159c8ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:57.395728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff7cc4-5bf3-4465-8366-a12a159c8ab7 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:57.397564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af5b83876a24f7e94be19c60752f346, user_id=5da9b69db8094a4a837f8fbfaffa1fc8, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:57.409254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:57.413770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 886/1777] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:57.432445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 892/1778] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:15:57 2022] PUT /identity/v3/projects/9af5b83876a24f7e94be19c60752f346/users/5da9b69db8094a4a837f8fbfaffa1fc8/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:57.452628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:57.452938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:57.453192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:57.510897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] MFA Rules not processed for user `5da9b69db8094a4a837f8fbfaffa1fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:57.516159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.652448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:57.717306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 887/1779] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:57.732167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:57.736377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:57.828056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2288bf-e92b-4a75-99e2-fc25eecd9a17 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:57.832160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:57.832803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:57.833086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:57.833363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:57.844416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:57.845911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:57.861212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 893/1780] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:57.949273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:57.951846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:58.015262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:58.017489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:58.037298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0271c50-bd02-4459-82ab-f422fb6e21a1 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:58.042593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:58.043589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.043942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.044749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.047622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:58.093481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894b8cf-ffae-46c9-a7d5-c38f1ec9e176 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:58.101714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:58.102810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.103796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.103796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] PATH_INFO: `/v3/projects/a4bfba90c76d471183f41843ffc12b07` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.105845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bfba90c76d471183f41843ffc12b07)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:58.110623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:58.189670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:58.190885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:58.210740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bfba90c76d471183f41843ffc12b07', 'request_id': 'req-cebcd5c3-7dad-45aa-b611-140d4d14b336'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.215518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 894/1781] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:58.226733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bfba90c76d471183f41843ffc12b07', 'request_id': 'req-cebcd5c3-7dad-45aa-b611-140d4d14b336'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.241965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bfba90c76d471183f41843ffc12b07', 'request_id': 'req-cebcd5c3-7dad-45aa-b611-140d4d14b336'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.289067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] The token cache is being invalidate because project a4bfba90c76d471183f41843ffc12b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:58.289675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.290824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.292966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 888/1782] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:57 2022] DELETE /identity/v3/projects/a4bfba90c76d471183f41843ffc12b07 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:15:58.299704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:58.316886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae555f37-ebdc-40a5-b469-5c5aa8156fcc service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:58.386531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:58.389509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:58.517776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:58.518600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.518958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.519362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] PATH_INFO: `/v3/users/550e50c7f8dc4eec9130cccd0d5104c3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.521531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=550e50c7f8dc4eec9130cccd0d5104c3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:58.524362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:58.610145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:58.616571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebcd5c3-7dad-45aa-b611-140d4d14b336 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:58.626949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:58.628862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.628862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.629084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] PATH_INFO: `/v3/users/3231601a3f5b4e2b81be0b5d0715e040` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.631736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3231601a3f5b4e2b81be0b5d0715e040)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:58.636392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:58.648656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:15:58.653719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550e50c7f8dc4eec9130cccd0d5104c3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.711328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550e50c7f8dc4eec9130cccd0d5104c3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.734394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550e50c7f8dc4eec9130cccd0d5104c3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.753227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3231601a3f5b4e2b81be0b5d0715e040'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.766815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550e50c7f8dc4eec9130cccd0d5104c3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.771096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ac78533c-3b50-40d2-9634-490dab3620ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550e50c7f8dc4eec9130cccd0d5104c3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.795531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 895/1783] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:58 2022] DELETE /identity/v3/users/550e50c7f8dc4eec9130cccd0d5104c3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:58.796664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3231601a3f5b4e2b81be0b5d0715e040'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.829012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3231601a3f5b4e2b81be0b5d0715e040'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.831986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3231601a3f5b4e2b81be0b5d0715e040'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.847820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3231601a3f5b4e2b81be0b5d0715e040'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:58.864380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 889/1784] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:58 2022] DELETE /identity/v3/users/3231601a3f5b4e2b81be0b5d0715e040 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:15:58.871640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:58.875455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:58.876141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:58.942219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:58.943614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.047904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 896/1785] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:59.073369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.077767 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.222582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab6a05-6fb1-4748-ba98-c6c4d26fcecd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.228785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03cd50-cbd8-43d6-9e0b-df65f8ae3a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.229334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cd50-cbd8-43d6-9e0b-df65f8ae3a43 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.230038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cd50-cbd8-43d6-9e0b-df65f8ae3a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.230210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03cd50-cbd8-43d6-9e0b-df65f8ae3a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.242955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03cd50-cbd8-43d6-9e0b-df65f8ae3a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.244608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03cd50-cbd8-43d6-9e0b-df65f8ae3a43 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.264172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 890/1786] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:15:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:15:59.436297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.441106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.497917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393c35e-8dfa-44be-8213-d911319e52f8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.523973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.526793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.528582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.530547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] PATH_INFO: `/v3/projects/d989b083e0c247c385192feb6376fb64` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.535957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d989b083e0c247c385192feb6376fb64)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.541355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.672529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd989b083e0c247c385192feb6376fb64', 'request_id': 'req-65e60a75-a5b2-47d7-b7fc-b2def233879d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.687375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd989b083e0c247c385192feb6376fb64', 'request_id': 'req-65e60a75-a5b2-47d7-b7fc-b2def233879d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.695891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd989b083e0c247c385192feb6376fb64', 'request_id': 'req-65e60a75-a5b2-47d7-b7fc-b2def233879d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.709590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] The token cache is being invalidate because project d989b083e0c247c385192feb6376fb64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:15:59.710115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.711151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-65e60a75-a5b2-47d7-b7fc-b2def233879d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:15:59.713080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 897/1787] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:59 2022] DELETE /identity/v3/projects/d989b083e0c247c385192feb6376fb64 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:15:59.720368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd94b5-6b21-4f9b-b8f3-e774728a7732 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.720965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd94b5-6b21-4f9b-b8f3-e774728a7732 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.721115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd94b5-6b21-4f9b-b8f3-e774728a7732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.746636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c6dd94b5-6b21-4f9b-b8f3-e774728a7732 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:59.749207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c6dd94b5-6b21-4f9b-b8f3-e774728a7732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.839020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 891/1788] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:59.848748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.850044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.850384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.885267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:15:59.887723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.909195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 898/1789] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:15:59.913998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd94b5-6b21-4f9b-b8f3-e774728a7732 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.931097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd94b5-6b21-4f9b-b8f3-e774728a7732 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.940032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.940597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.941243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.941526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.941792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.942496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:15:59.942954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.944432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.944691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:15:59.970199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 892/1790] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:15:59.971995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:15:59.973152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb3b3a-9c21-4084-8f10-a8dce0faa615 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:15:59.976126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:15:59.980082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:15:59.981130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:15:59.981479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:15:59.982037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] PATH_INFO: `/v3/projects/35281db69a3645feb85c64adc90d51f3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:15:59.984388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35281db69a3645feb85c64adc90d51f3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:15:59.986487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.008057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b93e-816c-4077-ab9a-552348d76a00 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.022396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.023978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.024846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.026436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] PATH_INFO: `/v3/users/c9359429165a405e890e96c0065304d2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.030043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9359429165a405e890e96c0065304d2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.035129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.044166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:00.060802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:00.089716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35281db69a3645feb85c64adc90d51f3', 'request_id': 'req-492885cd-8557-429b-8572-fa56e2451536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.102760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35281db69a3645feb85c64adc90d51f3', 'request_id': 'req-492885cd-8557-429b-8572-fa56e2451536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.115284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35281db69a3645feb85c64adc90d51f3', 'request_id': 'req-492885cd-8557-429b-8572-fa56e2451536'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.130169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] The token cache is being invalidate because project 35281db69a3645feb85c64adc90d51f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:00.130504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.131496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.136555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 899/1791] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:15:59 2022] DELETE /identity/v3/projects/35281db69a3645feb85c64adc90d51f3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:00.137746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.139530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.166821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9359429165a405e890e96c0065304d2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.189413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9359429165a405e890e96c0065304d2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.205856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9359429165a405e890e96c0065304d2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.206872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9359429165a405e890e96c0065304d2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.218956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9359429165a405e890e96c0065304d2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.232335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 893/1792] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:15:59 2022] DELETE /identity/v3/users/c9359429165a405e890e96c0065304d2 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:00.233735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.238194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.282155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492885cd-8557-429b-8572-fa56e2451536 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.349410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0b15e2-7c29-457d-91fa-b64bf49461ff admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.355046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.356147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.356963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.357323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] PATH_INFO: `/v3/users/44f06b07ba1b4b47b3c221958379cc0c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.358904 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f06b07ba1b4b47b3c221958379cc0c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.361066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.375183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b44c-3f95-4f72-87c2-6d1f958612b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.376047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b44c-3f95-4f72-87c2-6d1f958612b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.376397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b44c-3f95-4f72-87c2-6d1f958612b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.376987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b44c-3f95-4f72-87c2-6d1f958612b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.377652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b44c-3f95-4f72-87c2-6d1f958612b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.379698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b44c-3f95-4f72-87c2-6d1f958612b0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.417623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 900/1793] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:00 2022] POST /identity/v3/projects => generated 353 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:00.419053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.419396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.419743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.432428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f06b07ba1b4b47b3c221958379cc0c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.445213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:00.446521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.461353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f06b07ba1b4b47b3c221958379cc0c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.472448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f06b07ba1b4b47b3c221958379cc0c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.473555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f06b07ba1b4b47b3c221958379cc0c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.484703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f06b07ba1b4b47b3c221958379cc0c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:00.492502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 894/1794] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:00 2022] DELETE /identity/v3/users/44f06b07ba1b4b47b3c221958379cc0c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:00.493361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.497590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.500533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:00.511394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:00.534153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 901/1795] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:00.550898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.553275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.620494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963be4a2-0c32-4aeb-a130-8fabd1884cd6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.627604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.628969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.628969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.628969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.629543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.632223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.677976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 895/1796] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:00 2022] POST /identity/v3/users => generated 277 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:00.681828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef7240-da5f-406a-9d79-107c15ae6077 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.684302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.697688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3689210-717e-4ef2-90e5-05ec7388c715 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.705615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.706568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.707603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.707962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.708794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.710629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.728067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 896/1797] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:00.734268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.749716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af084de6-4647-4db8-90e5-7fffd3d19e34 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.756530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.757817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.758310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.758629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.759275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.761520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.771050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb570b-5803-493a-8233-02e0b2659dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.772645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb570b-5803-493a-8233-02e0b2659dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.773542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb570b-5803-493a-8233-02e0b2659dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.774047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb570b-5803-493a-8233-02e0b2659dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.778706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 897/1798] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:00.780276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.793379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb570b-5803-493a-8233-02e0b2659dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.796400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb570b-5803-493a-8233-02e0b2659dcf service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.799030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073709d-a2e8-4e1c-b30c-2007aa4284b1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:00.808351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 902/1799] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:00.808589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:00.809807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.810490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.811066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] PATH_INFO: `/v3/projects/81315cf0b82d4a72868e571172e379ae/users/a311a677998a4700a81ec079f83b3bfa/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.843941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=81315cf0b82d4a72868e571172e379ae, user_id=a311a677998a4700a81ec079f83b3bfa, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:00.852621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:00.901052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 898/1800] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:00 2022] PUT /identity/v3/projects/81315cf0b82d4a72868e571172e379ae/users/a311a677998a4700a81ec079f83b3bfa/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:00.912727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493b6f-d9c6-4aaa-a9f1-944bf1023093 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:00.913401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493b6f-d9c6-4aaa-a9f1-944bf1023093 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:00.913594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72493b6f-d9c6-4aaa-a9f1-944bf1023093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:00.927242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:00.929163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:00.988280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-72493b6f-d9c6-4aaa-a9f1-944bf1023093 None None] MFA Rules not processed for user `a311a677998a4700a81ec079f83b3bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:00.995245 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-72493b6f-d9c6-4aaa-a9f1-944bf1023093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.049998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee2fd1-0dbf-4fba-bc3c-cfce36d299cd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.055758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.056477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.056886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.057298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] PATH_INFO: `/v3/projects/002e6130cc0c490a8496b0b25aedcd67` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.058948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=002e6130cc0c490a8496b0b25aedcd67)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.061141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.106138 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 903/1801] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:01.112079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72493b6f-d9c6-4aaa-a9f1-944bf1023093 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.126210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72493b6f-d9c6-4aaa-a9f1-944bf1023093 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.126442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002e6130cc0c490a8496b0b25aedcd67', 'request_id': 'req-a3bf66a0-1060-4c2b-b266-e78bdbca5305'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.128840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:01.136629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002e6130cc0c490a8496b0b25aedcd67', 'request_id': 'req-a3bf66a0-1060-4c2b-b266-e78bdbca5305'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.145544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002e6130cc0c490a8496b0b25aedcd67', 'request_id': 'req-a3bf66a0-1060-4c2b-b266-e78bdbca5305'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.159585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] The token cache is being invalidate because project 002e6130cc0c490a8496b0b25aedcd67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:01.160062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.160828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a3bf66a0-1060-4c2b-b266-e78bdbca5305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.166007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:01.166192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 899/1802] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:00 2022] DELETE /identity/v3/projects/002e6130cc0c490a8496b0b25aedcd67 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:01.168275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf614-1fc3-4380-8b82-e80b93d63ec4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.168566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf614-1fc3-4380-8b82-e80b93d63ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.168925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf614-1fc3-4380-8b82-e80b93d63ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.223282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.224669 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.225083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.225371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.226273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.226846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ea7bf614-1fc3-4380-8b82-e80b93d63ec4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:01.228410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.229594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ea7bf614-1fc3-4380-8b82-e80b93d63ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.246352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 900/1803] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:01.255548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dffe-3de5-4a62-a26f-82e5b935cf9e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.256041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dffe-3de5-4a62-a26f-82e5b935cf9e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.256597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6dffe-3de5-4a62-a26f-82e5b935cf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.273967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 904/1804] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:01 2022] POST /identity/v3/projects => generated 355 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:01.278165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.281007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.303407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-91b6dffe-3de5-4a62-a26f-82e5b935cf9e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:01.306196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-91b6dffe-3de5-4a62-a26f-82e5b935cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.387788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50dd84-9a26-4072-880a-b320fb8f88ae admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.394545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.395715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.396016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.396362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.397132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.399502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.432154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 905/1805] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:01 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:01.433030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.434784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.448626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2668cc-8dbe-4285-83e5-0adb8b3c8115 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.450813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 901/1806] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:01.453074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6dffe-3de5-4a62-a26f-82e5b935cf9e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.454503 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.455472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.455753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.456032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] PATH_INFO: `/v3/projects/90953bf371c34f5b9bca60333a49d514` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.457257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=90953bf371c34f5b9bca60333a49d514)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.459368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.470426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6dffe-3de5-4a62-a26f-82e5b935cf9e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.476055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.476948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.477408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.477855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.478752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.480597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.500512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 902/1807] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:01.501424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.514402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e761e00-325c-47d8-bdcd-f77b2847e94d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.521751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.522794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.523248 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.523703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.524818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:01.525310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.528105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.542474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90953bf371c34f5b9bca60333a49d514', 'request_id': 'req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.549310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 903/1808] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:01.550725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.553162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.555332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90953bf371c34f5b9bca60333a49d514', 'request_id': 'req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.567220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90953bf371c34f5b9bca60333a49d514', 'request_id': 'req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.569488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29a36d-89be-492b-be78-6c1cc23a2c53 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.581950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] The token cache is being invalidate because project 90953bf371c34f5b9bca60333a49d514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:01.582352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.583401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.585831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 906/1809] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:01 2022] DELETE /identity/v3/projects/90953bf371c34f5b9bca60333a49d514 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:01.590956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.592693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.639997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:01.660274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.661241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.661629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.662045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] PATH_INFO: `/v3/users/d76e0dceda8e450eb2a4c9e332fc6862` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.664419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76e0dceda8e450eb2a4c9e332fc6862)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.668240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.690293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bbbb7-9c2d-464e-b00d-6b48ac5e08fc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.697330 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.698315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.698895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.699296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] PATH_INFO: `/v3/projects/f12522ef1c434901a040e6d5f2a01b91/users/376fb0beab3a40168e6f6568b675f096/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.725976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12522ef1c434901a040e6d5f2a01b91, user_id=376fb0beab3a40168e6f6568b675f096, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.729945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.744716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76e0dceda8e450eb2a4c9e332fc6862'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.749392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:INSERT=1,keystone:DELETE=10,keystone:SELECT=89 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:01.750460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 907/1810] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:01 2022] PUT /identity/v3/projects/f12522ef1c434901a040e6d5f2a01b91/users/376fb0beab3a40168e6f6568b675f096/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:01.755360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.755360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.771034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76e0dceda8e450eb2a4c9e332fc6862'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.780958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76e0dceda8e450eb2a4c9e332fc6862'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.781816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76e0dceda8e450eb2a4c9e332fc6862'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.794919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76e0dceda8e450eb2a4c9e332fc6862'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:01.806127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 904/1811] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:01 2022] DELETE /identity/v3/users/d76e0dceda8e450eb2a4c9e332fc6862 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:01.807446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:01.809306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:01.863035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0c80c-7d6a-4c14-b247-2c8558fa5e18 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.911190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52d56f2-a7e8-45af-b67a-c8cdf9370206 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:01.921622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.922949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.923412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.924119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] PATH_INFO: `/v3/users/2750c3311b674103b52d5245933ef971` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.926556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2750c3311b674103b52d5245933ef971)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.930667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:01.962146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:01.964159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:01.964640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:01.964930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:01.965612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:01.969064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.013426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 908/1812] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:01 2022] POST /identity/v3/projects => generated 387 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:02.017462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.020309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.052296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2750c3311b674103b52d5245933ef971'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.089623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2750c3311b674103b52d5245933ef971'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.109716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2750c3311b674103b52d5245933ef971'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.111829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2750c3311b674103b52d5245933ef971'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.118139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:02.134938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d75b4082-117b-47ac-86e9-d7142029aa9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2750c3311b674103b52d5245933ef971'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.163293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f302425-2b00-4dab-b376-e09448972091 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.164005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 905/1813] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:01 2022] DELETE /identity/v3/users/2750c3311b674103b52d5245933ef971 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:02.164005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.164005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.164005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.211887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:02.220953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.283927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.285159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.285627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.286075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.286949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.289505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.306020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:02.310339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 909/1814] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:02.310339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.312047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.328399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4c44-061b-44ea-8679-d69738ca37b2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.334097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.334786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.335067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.335586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.336010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.338100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.373944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 906/1815] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:02.374399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 910/1816] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:02 2022] POST /identity/v3/users => generated 294 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:02.374537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.374537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.382490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.395990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591841-b9c3-4cee-9c89-003500e89692 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.402268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.403472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.404013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.406050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.406633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.410522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.416968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec11c6c-024f-4e49-8c91-96b09853b2ef None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.432551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.433825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.434405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.434892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] PATH_INFO: `/v3/projects/f12522ef1c434901a040e6d5f2a01b91/users/376fb0beab3a40168e6f6568b675f096/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.440217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f12522ef1c434901a040e6d5f2a01b91, user_id=376fb0beab3a40168e6f6568b675f096, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.446226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.452040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 911/1817] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:02.454686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.458857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.479803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 907/1818] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:02 2022] PUT /identity/v3/projects/f12522ef1c434901a040e6d5f2a01b91/users/376fb0beab3a40168e6f6568b675f096/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:02.480739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.584176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd940d-0b70-41be-94d3-1dc1b22d98eb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.615003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6ff5-2ddb-431f-acfd-257554f35f74 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.621656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb44928-f089-49bd-a47c-4f63d63628cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.622604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44928-f089-49bd-a47c-4f63d63628cb admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.622997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44928-f089-49bd-a47c-4f63d63628cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.623410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb44928-f089-49bd-a47c-4f63d63628cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.624421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44928-f089-49bd-a47c-4f63d63628cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.626135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb44928-f089-49bd-a47c-4f63d63628cb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.639654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 908/1819] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:02.644142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.644423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.644706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.690418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] MFA Rules not processed for user `376fb0beab3a40168e6f6568b675f096`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:02.692477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.695237 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.696214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.696703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.697225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.713911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.716568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.736467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 912/1820] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:02.739782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.759210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137661e8-84fd-4331-8e13-536dc3c10738 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.769241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.770477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.770963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.771840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] PATH_INFO: `/v3/projects/864807dcad014862b88cf0339e35c5f9/users/14a239510f044d5eb0be79f35de97952/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.801288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 909/1821] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:02.802796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.809259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.825314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864807dcad014862b88cf0339e35c5f9, user_id=14a239510f044d5eb0be79f35de97952, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.832561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e83e-c316-4775-bf02-97f7f8b8dd7b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.833647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.839039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:02.839244 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:02.839781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.840069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.840405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] PATH_INFO: `/v3/projects/2b92ff267625431da80fa2bd129b227d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:02.843611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b92ff267625431da80fa2bd129b227d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:02.846472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:02.860919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 913/1822] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:02 2022] PUT /identity/v3/projects/864807dcad014862b88cf0339e35c5f9/users/14a239510f044d5eb0be79f35de97952/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:02.862935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:02.865779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:02.938710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b92ff267625431da80fa2bd129b227d', 'request_id': 'req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.941866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:02.952459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b92ff267625431da80fa2bd129b227d', 'request_id': 'req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.966320 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b92ff267625431da80fa2bd129b227d', 'request_id': 'req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.983517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6104e-2a8b-42b8-abe6-25ff17cc6557 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:02.991147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] The token cache is being invalidate because project 2b92ff267625431da80fa2bd129b227d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:02.991565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.992770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7852fce3-7b44-4dae-b4ef-17dceca8bd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:02.999720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 910/1823] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:02 2022] DELETE /identity/v3/projects/2b92ff267625431da80fa2bd129b227d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:02.999720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a3ba-4d4e-458f-8c13-a604f8d11725 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:02.999720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a3ba-4d4e-458f-8c13-a604f8d11725 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:02.999720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a3ba-4d4e-458f-8c13-a604f8d11725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.067353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d359a3ba-4d4e-458f-8c13-a604f8d11725 None None] MFA Rules not processed for user `14a239510f044d5eb0be79f35de97952`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:03.070588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d359a3ba-4d4e-458f-8c13-a604f8d11725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.093765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.094549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.094894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.095251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.097820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.223057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.227825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.241106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 911/1824] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:03.241106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.241106 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.241411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.252680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 914/1825] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:03.254584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:03.256880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.297467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:03.298790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.459896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442e80e-cad1-4620-857d-1ef391b6f13f service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.468807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.469485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.469803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.470111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.470837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.473684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.478692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:03.495510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 912/1826] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:03.503640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:03.505027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.525302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 915/1827] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:03 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:03.525302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:03.526727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.526844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3525c3b-f468-4dbd-a650-1c7c5cfddf1d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.615576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413fbb-f8ab-4cd2-ab1e-f32932d040a5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.619974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd271bd2-5162-4568-9f38-82ada1a86a95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.620614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271bd2-5162-4568-9f38-82ada1a86a95 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.620904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271bd2-5162-4568-9f38-82ada1a86a95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.621179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271bd2-5162-4568-9f38-82ada1a86a95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.624077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fd271bd2-5162-4568-9f38-82ada1a86a95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.631514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.632550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.633010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.633469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] PATH_INFO: `/v3/projects/45d9c07b19a747bfa17151361b83c61e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.635621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d9c07b19a747bfa17151361b83c61e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.639670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.665613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:03.712516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd271bd2-5162-4568-9f38-82ada1a86a95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.714666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd271bd2-5162-4568-9f38-82ada1a86a95 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.726578 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 916/1828] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:03.729559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.729818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.730091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.755152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:03.756433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.766430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d9c07b19a747bfa17151361b83c61e', 'request_id': 'req-34c40b39-6f6a-4345-98f4-2e9be7ae595d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.784857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d9c07b19a747bfa17151361b83c61e', 'request_id': 'req-34c40b39-6f6a-4345-98f4-2e9be7ae595d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.798975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d9c07b19a747bfa17151361b83c61e', 'request_id': 'req-34c40b39-6f6a-4345-98f4-2e9be7ae595d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.819319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] The token cache is being invalidate because project 45d9c07b19a747bfa17151361b83c61e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:03.820373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.821702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:03.827077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 913/1829] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:03 2022] DELETE /identity/v3/projects/45d9c07b19a747bfa17151361b83c61e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:03.828069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:03.831368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.853725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 917/1830] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:03.853725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:03.853725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:03.869822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3443b7-3ebe-47be-bf20-26462aa88cbc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.875778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.876448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.876730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.877038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] PATH_INFO: `/v3/users/5da9b69db8094a4a837f8fbfaffa1fc8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.878891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da9b69db8094a4a837f8fbfaffa1fc8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.883878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.941200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40b39-6f6a-4345-98f4-2e9be7ae595d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:03.949272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:03.950111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:03.950616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:03.951098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:03.952678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:03.955183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:03.979501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:03.996232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 914/1831] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:03 2022] POST /identity/v3/users => generated 300 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:03.998840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.000216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da9b69db8094a4a837f8fbfaffa1fc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.017005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da9b69db8094a4a837f8fbfaffa1fc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.018376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25a94c-660a-41e8-accb-10910882f38a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.026723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.027793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.028282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.028523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da9b69db8094a4a837f8fbfaffa1fc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.028743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.030424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:04.030968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.034768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.039984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da9b69db8094a4a837f8fbfaffa1fc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.040963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da9b69db8094a4a837f8fbfaffa1fc8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.048820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 918/1832] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:03 2022] DELETE /identity/v3/users/5da9b69db8094a4a837f8fbfaffa1fc8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:04.050319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.052730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.063273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 915/1833] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:04.069129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.071230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.088250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436fe2-01f9-4ae0-bcd3-82d3672856ac admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.192382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c972ff8-cac0-4fa5-be9e-6e94eb6f19de admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.195796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.196622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.197134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.197439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.198103 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.200769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.205544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.206654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.207154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.207713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.208944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.214448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.238377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:04.246007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 919/1834] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:04.247396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.256852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 916/1835] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:04.261126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.264964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c923176-1b5a-4d6f-a348-9876546f0776 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.365458 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.366694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.367179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.367713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] PATH_INFO: `/v3/projects/caf5bb1281634494b5d4f9f5118b6e9a/users/22a8907ff8f34e4bae7f6ea36e7eb1d6/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.387921 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d143e4-3326-4d41-ac8b-7a54d571895b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.395778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf5bb1281634494b5d4f9f5118b6e9a, user_id=22a8907ff8f34e4bae7f6ea36e7eb1d6, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.399053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.400522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.400777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.401074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.401654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.402998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.407369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.433150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 920/1836] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:04 2022] PUT /identity/v3/projects/caf5bb1281634494b5d4f9f5118b6e9a/users/22a8907ff8f34e4bae7f6ea36e7eb1d6/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:04.440865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.466944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 917/1837] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:04.468160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.487417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62bbdb-dc24-4302-ba92-b0e4a728c716 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.542544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:04.617739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.620149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.620608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.621196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.622756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.627173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.632947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aef5b0-ba86-42c5-b54f-1d6c09ed93d6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.644978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.645936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.646518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.647573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.648751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.652170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.676952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 921/1838] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:04.676952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.679529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.690534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 918/1839] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:04.692213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.703222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5e209-70a1-4d72-97bb-58a838bebadf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.704584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a447c80-9531-4fb2-9a78-aba5b8cbef87 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.709461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.710144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.710465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.710740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] PATH_INFO: `/v3/projects/caf5bb1281634494b5d4f9f5118b6e9a/users/22a8907ff8f34e4bae7f6ea36e7eb1d6/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.711202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.712241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.712769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.712898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf5bb1281634494b5d4f9f5118b6e9a, user_id=22a8907ff8f34e4bae7f6ea36e7eb1d6, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.713369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] PATH_INFO: `/v3/projects/9af5b83876a24f7e94be19c60752f346` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.715780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.716082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af5b83876a24f7e94be19c60752f346)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.720433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.732037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 919/1840] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:04 2022] PUT /identity/v3/projects/caf5bb1281634494b5d4f9f5118b6e9a/users/22a8907ff8f34e4bae7f6ea36e7eb1d6/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:04.735495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:04.804592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af5b83876a24f7e94be19c60752f346', 'request_id': 'req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.815660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af5b83876a24f7e94be19c60752f346', 'request_id': 'req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.824571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe7be3-e8eb-4ee2-84de-b1be3e3e1ec1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:04.826658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af5b83876a24f7e94be19c60752f346', 'request_id': 'req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.853143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] The token cache is being invalidate because project 9af5b83876a24f7e94be19c60752f346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:04.853143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.855987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b3bd0b5b-bbd1-4498-a68e-088a6d9a57e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:04.863591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 922/1841] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:04 2022] DELETE /identity/v3/projects/9af5b83876a24f7e94be19c60752f346 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:04.863591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bca5-9486-49ea-bd8a-c59d18747608 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.863591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bca5-9486-49ea-bd8a-c59d18747608 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.863591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943bca5-9486-49ea-bd8a-c59d18747608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.868903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:04.911791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2943bca5-9486-49ea-bd8a-c59d18747608 None None] MFA Rules not processed for user `22a8907ff8f34e4bae7f6ea36e7eb1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:04.916457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2943bca5-9486-49ea-bd8a-c59d18747608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:04.974281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3feffa2-f753-48eb-9088-89302aee072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:04.975014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feffa2-f753-48eb-9088-89302aee072b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.975354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feffa2-f753-48eb-9088-89302aee072b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.975727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feffa2-f753-48eb-9088-89302aee072b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:04.976485 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3feffa2-f753-48eb-9088-89302aee072b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:04.978510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3feffa2-f753-48eb-9088-89302aee072b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:04.994264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 920/1842] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:04.997406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:04.998610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:04.998911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.030303 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:05.031617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.048581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 921/1843] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:05.049563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.051263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.068194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f1297-36dc-4bca-ac77-7e43b90b909f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.075033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.075834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.076368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.076795 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] PATH_INFO: `/v3/projects/f654a4341f3f4e59ab9324a6605632fc/users/4d7dfadc0f254a8186d4cff75c5d220e/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.090616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 923/1844] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:05.090616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df094-9a49-4c1d-915f-0759d32488e4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.090616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df094-9a49-4c1d-915f-0759d32488e4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.090616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8df094-9a49-4c1d-915f-0759d32488e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.108615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f654a4341f3f4e59ab9324a6605632fc, user_id=4d7dfadc0f254a8186d4cff75c5d220e, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.114449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.133786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 922/1845] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:05 2022] PUT /identity/v3/projects/f654a4341f3f4e59ab9324a6605632fc/users/4d7dfadc0f254a8186d4cff75c5d220e/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:05.134282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7c8df094-9a49-4c1d-915f-0759d32488e4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:05.135157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.135805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c8df094-9a49-4c1d-915f-0759d32488e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.139350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.181439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:05.231471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 924/1846] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:05.234675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de9b6-2f89-4b87-a132-0ed45aca1af1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.235166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de9b6-2f89-4b87-a132-0ed45aca1af1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.235652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249de9b6-2f89-4b87-a132-0ed45aca1af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.261228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe217831-9822-4f44-a0fc-0d352c1ccd90 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.266863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.267625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.267926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.268264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.319937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-249de9b6-2f89-4b87-a132-0ed45aca1af1 None None] MFA Rules not processed for user `4d7dfadc0f254a8186d4cff75c5d220e`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:05.322018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-249de9b6-2f89-4b87-a132-0ed45aca1af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:05.382562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.385958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.402948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 923/1847] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:05.404956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.423768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c151ef0-9b37-43a4-8206-a37017f3c2f4 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.435518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.436572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.437035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.437493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.438656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:05.439158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.442941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.473925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 924/1848] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:05.475172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.492461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7f32a-b5e8-4262-924f-9de2237ffb55 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.504487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 925/1849] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:05.511205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de9b6-2f89-4b87-a132-0ed45aca1af1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.512683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.514125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.514797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.515475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.516315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.519255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.532727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249de9b6-2f89-4b87-a132-0ed45aca1af1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.541454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.542920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.543566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.544031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.545463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.549353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.553910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:05.574510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 925/1850] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:05.578677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.609870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 926/1851] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:05.617195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.778472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261421a-f737-4fec-94e5-fc4275091e06 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.830272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827befa-e7cf-453d-aaa2-bbc688c1bee8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.836776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.837581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.837919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.838200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.839123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.841153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.874307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 927/1852] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:05.878163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.879382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.880461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.880461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.898909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.898909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.898909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.900084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e66b5-801e-4cf6-b936-99c5e3eed8a7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.912582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 926/1853] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:05 2022] POST /identity/v3/users => generated 288 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:05.915450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.915832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.916326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.916490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.916709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.917510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.919588 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.927294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31174565-214a-4601-bf43-df026e3e4264 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.933581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 928/1854] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:05.934109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.936586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.936793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.937028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.937726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.938751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.939609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.955978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f0805-27b6-4c29-97e6-b3934ad951f4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:05.961938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:05.962599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:05.962868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:05.963469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:05.964163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:05.965819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:05.972782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 927/1855] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:05.983270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 929/1856] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:05.983475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.984943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:05.999942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620f9f-a3c8-4de4-b2a2-7e4842a74e8c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.007651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab603e9-1e48-4f87-9f68-90ed49b765d6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.010431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.011521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.012060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.013082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.015358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.015637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d38f0-fe03-4238-9e65-4013e7888221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.017025 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d38f0-fe03-4238-9e65-4013e7888221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.017548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d38f0-fe03-4238-9e65-4013e7888221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.017927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d38f0-fe03-4238-9e65-4013e7888221 admin admin] PATH_INFO: `/v3/projects/3bbe577f862c44bdbe18981dbb1d2854/users/f82fe7ea8506495eab67d9120251af51/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.018955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.028019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:06.039890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d38f0-fe03-4238-9e65-4013e7888221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bbe577f862c44bdbe18981dbb1d2854, user_id=f82fe7ea8506495eab67d9120251af51, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.043442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d38f0-fe03-4238-9e65-4013e7888221 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.051156 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 928/1857] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:06.058545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.072632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b41521-0da6-45c9-b72a-7b48bbddd2e5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.075839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 930/1858] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:05 2022] PUT /identity/v3/projects/3bbe577f862c44bdbe18981dbb1d2854/users/f82fe7ea8506495eab67d9120251af51/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:06.095084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81acc8-36ad-4617-81d7-3a5c57c71a6f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.096072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81acc8-36ad-4617-81d7-3a5c57c71a6f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.096072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81acc8-36ad-4617-81d7-3a5c57c71a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.155179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fb81acc8-36ad-4617-81d7-3a5c57c71a6f None None] MFA Rules not processed for user `f82fe7ea8506495eab67d9120251af51`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:06.156711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fb81acc8-36ad-4617-81d7-3a5c57c71a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:06.163213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870347e0-bcb2-465b-a067-20cb934ffd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.164041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870347e0-bcb2-465b-a067-20cb934ffd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.164399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870347e0-bcb2-465b-a067-20cb934ffd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.164824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870347e0-bcb2-465b-a067-20cb934ffd9b admin admin] PATH_INFO: `/v3/projects/63d7ba3b8db34bb5bf2c7df3889d4bce/users/c48a200229df4819934f6e3c12df38a1/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.190060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870347e0-bcb2-465b-a067-20cb934ffd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d7ba3b8db34bb5bf2c7df3889d4bce, user_id=c48a200229df4819934f6e3c12df38a1, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.193471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870347e0-bcb2-465b-a067-20cb934ffd9b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.206232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:06.216408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 929/1859] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:06 2022] PUT /identity/v3/projects/63d7ba3b8db34bb5bf2c7df3889d4bce/users/c48a200229df4819934f6e3c12df38a1/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:06.230444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.231315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.231315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.267825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] MFA Rules not processed for user `c48a200229df4819934f6e3c12df38a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:06.271716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 931/1860] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:06.271911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:06.274211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81acc8-36ad-4617-81d7-3a5c57c71a6f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.291197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81acc8-36ad-4617-81d7-3a5c57c71a6f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.401048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.402315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.402546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 930/1861] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:06.402707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.402707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.403216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.405316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.422633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.425264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:06.478891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 932/1862] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:06 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:06.486299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.601676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c1249-c28b-4591-bdb0-a5a5971218e1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.639600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383178e7-40c8-498d-8ac2-53efacd8e4e8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.657818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.660147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.660901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.661510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.662840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.667248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.688250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:06.708574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 933/1863] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:06 2022] POST /identity/v3/users => generated 300 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:06.709823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.712227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '916a9bae3ca94918af4efdfcae19d928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.712416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:06.712876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.713168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.713588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.735460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36f3ee-195e-4ef8-8178-9d6ecd64b342 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.743807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.744896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.745387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.745841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] PATH_INFO: `/v3/users/14a239510f044d5eb0be79f35de97952` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.749289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a239510f044d5eb0be79f35de97952)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.753230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.782725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:06.829541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.833251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.851361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 931/1864] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:06.852545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:06.868560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a239510f044d5eb0be79f35de97952'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.880345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f6f64-9641-43d9-8449-f161cf05fd3f service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:06.915716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a239510f044d5eb0be79f35de97952'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.916708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:06.919098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:06.920632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:06.923934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:06.927903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:06.935745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:06.940184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a239510f044d5eb0be79f35de97952'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.964032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a239510f044d5eb0be79f35de97952'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.965430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0a9f1058-25bb-4be6-ba0c-d7eb1d7a84bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a239510f044d5eb0be79f35de97952'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:06.995065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 934/1865] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:06 2022] DELETE /identity/v3/users/14a239510f044d5eb0be79f35de97952 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:06.998821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be633e-7cf5-4d5d-af1a-1dc2c4071eda None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.003647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be633e-7cf5-4d5d-af1a-1dc2c4071eda None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.004436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be633e-7cf5-4d5d-af1a-1dc2c4071eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.038602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 932/1866] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:07.054648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:07.074027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.083037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-78be633e-7cf5-4d5d-af1a-1dc2c4071eda None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:07.086370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-78be633e-7cf5-4d5d-af1a-1dc2c4071eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.132248 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d4db2-ad41-4748-8b0b-c6748aba0791 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:07.327987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:07.329530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.330111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.330546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] PATH_INFO: `/v3/projects/83a7856c99e047068cb49ce97f5fe95d/users/c7457223f2b341599695bc6163807041/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.363193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a7856c99e047068cb49ce97f5fe95d, user_id=c7457223f2b341599695bc6163807041, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:07.378125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:07.381489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 935/1867] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:07.393217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 933/1868] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:07 2022] PUT /identity/v3/projects/83a7856c99e047068cb49ce97f5fe95d/users/c7457223f2b341599695bc6163807041/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:07.397186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be633e-7cf5-4d5d-af1a-1dc2c4071eda None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:07.405171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:07.412113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.415547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be633e-7cf5-4d5d-af1a-1dc2c4071eda None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:07.519680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:07.520597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.521034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.521456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.522310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:07.524244 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:07.531344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:07.543209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 936/1869] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:07.544133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:07.549210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8bd88-a167-4328-8e8d-91d2b9d83b21 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:07.555961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa64a4-9695-40a4-9448-468222ebc62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:07.557093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa64a4-9695-40a4-9448-468222ebc62f service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.557551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa64a4-9695-40a4-9448-468222ebc62f service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.558424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa64a4-9695-40a4-9448-468222ebc62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.562097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3eaaef-278c-45c7-a580-cbfd7d27ab24 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:07.569263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:07.570223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.570606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.570950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] PATH_INFO: `/v3/projects/83a7856c99e047068cb49ce97f5fe95d/users/c7457223f2b341599695bc6163807041/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.573216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a7856c99e047068cb49ce97f5fe95d, user_id=c7457223f2b341599695bc6163807041, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:07.575080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa64a4-9695-40a4-9448-468222ebc62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:07.577372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:07.578528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa64a4-9695-40a4-9448-468222ebc62f service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:07.596560 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 934/1870] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:07.607839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 937/1871] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:07 2022] PUT /identity/v3/projects/83a7856c99e047068cb49ce97f5fe95d/users/c7457223f2b341599695bc6163807041/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:07.628505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.629062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.629370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.668219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] MFA Rules not processed for user `c7457223f2b341599695bc6163807041`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:07.669502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.752240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:07.838293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 935/1872] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:07.851211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:07.855855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:07.948990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec62f8-0461-4199-b904-13dd6ed78e33 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:07.954134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:07.954820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:07.955102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:07.955379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:07.969351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:07.969894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:07.983165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 938/1873] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:08.099080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:08.101023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.194701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f61765-03c2-4fc2-920b-b429a90409bb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:08.200422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.201805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.202193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.202657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] PATH_INFO: `/v3/projects/864807dcad014862b88cf0339e35c5f9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.204423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864807dcad014862b88cf0339e35c5f9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:08.206630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:08.292226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864807dcad014862b88cf0339e35c5f9', 'request_id': 'req-f8577c6b-dd10-43fb-b414-b18606fcaf86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.306364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864807dcad014862b88cf0339e35c5f9', 'request_id': 'req-f8577c6b-dd10-43fb-b414-b18606fcaf86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.316971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864807dcad014862b88cf0339e35c5f9', 'request_id': 'req-f8577c6b-dd10-43fb-b414-b18606fcaf86'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.332264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] The token cache is being invalidate because project 864807dcad014862b88cf0339e35c5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:08.332674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.333418 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f8577c6b-dd10-43fb-b414-b18606fcaf86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.335627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 936/1874] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:08 2022] DELETE /identity/v3/projects/864807dcad014862b88cf0339e35c5f9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:08.340847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:08.354047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f779ed-eb0c-423c-87cd-528ff271a356 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:08.472711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:08.473746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.474348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.474712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] PATH_INFO: `/v3/users/22a8907ff8f34e4bae7f6ea36e7eb1d6` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.476780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a8907ff8f34e4bae7f6ea36e7eb1d6)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:08.482325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:08.572794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:08.573258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:08.574550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:08.660776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a8907ff8f34e4bae7f6ea36e7eb1d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.706024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a8907ff8f34e4bae7f6ea36e7eb1d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.719648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:08.721920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:08.728861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a8907ff8f34e4bae7f6ea36e7eb1d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.744877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a8907ff8f34e4bae7f6ea36e7eb1d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.745708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a8907ff8f34e4bae7f6ea36e7eb1d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:08.759532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 939/1875] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:08 2022] DELETE /identity/v3/users/22a8907ff8f34e4bae7f6ea36e7eb1d6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:08.866162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:08.958058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 937/1876] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:16:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:09.166009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:09.168334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.196230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:09.210637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:09.212313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.324279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1564cd-68c0-41af-aa3b-eb7770696942 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:09.381570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11fc49-7dc9-497c-a7d3-2f94094df4b3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:09.389846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:09.390677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.391172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.391453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.418950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646845-6436-44b4-a7ac-09671f8e7944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:09.420430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646845-6436-44b4-a7ac-09671f8e7944 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.420430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646845-6436-44b4-a7ac-09671f8e7944 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.420751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646845-6436-44b4-a7ac-09671f8e7944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.422787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-05646845-6436-44b4-a7ac-09671f8e7944 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.472820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.474661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.487307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 940/1877] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:16:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:16:09.488615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:09.490481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:09.509583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646845-6436-44b4-a7ac-09671f8e7944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.513778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646845-6436-44b4-a7ac-09671f8e7944 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.526490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 938/1878] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:09.628176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44102-eab2-461b-8a5c-01c64c35edab service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:09.634384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:09.635032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.635311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.635568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] PATH_INFO: `/v3/projects/caf5bb1281634494b5d4f9f5118b6e9a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.639852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf5bb1281634494b5d4f9f5118b6e9a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:09.647214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:09.755497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:09.802936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf5bb1281634494b5d4f9f5118b6e9a', 'request_id': 'req-f42e0783-4c5f-4110-acb7-19c8e4fbf522'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.836831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf5bb1281634494b5d4f9f5118b6e9a', 'request_id': 'req-f42e0783-4c5f-4110-acb7-19c8e4fbf522'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.838060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf5bb1281634494b5d4f9f5118b6e9a', 'request_id': 'req-f42e0783-4c5f-4110-acb7-19c8e4fbf522'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.855276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] The token cache is being invalidate because project caf5bb1281634494b5d4f9f5118b6e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:09.855433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.856312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f42e0783-4c5f-4110-acb7-19c8e4fbf522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:09.867310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 941/1879] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:09 2022] DELETE /identity/v3/projects/caf5bb1281634494b5d4f9f5118b6e9a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:09.877078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec545d-c19d-4d19-b9a1-c1e7120aff80 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:09.877587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec545d-c19d-4d19-b9a1-c1e7120aff80 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:09.878115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec545d-c19d-4d19-b9a1-c1e7120aff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:09.921742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fcec545d-c19d-4d19-b9a1-c1e7120aff80 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:09.923853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fcec545d-c19d-4d19-b9a1-c1e7120aff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.166810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:10.206228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 939/1880] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:10.218626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa7fcb-c440-4565-bd86-d5cd27b7b97c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.219764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa7fcb-c440-4565-bd86-d5cd27b7b97c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.220387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa7fcb-c440-4565-bd86-d5cd27b7b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.264778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-72fa7fcb-c440-4565-bd86-d5cd27b7b97c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:10.266398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-72fa7fcb-c440-4565-bd86-d5cd27b7b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.276736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 942/1881] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:10.282063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec545d-c19d-4d19-b9a1-c1e7120aff80 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.292698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec545d-c19d-4d19-b9a1-c1e7120aff80 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.298636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.299411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.299697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.299989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.300660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:10.300945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.302643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.316946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 940/1882] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:10.321719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa7fcb-c440-4565-bd86-d5cd27b7b97c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.332319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa7fcb-c440-4565-bd86-d5cd27b7b97c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.337706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.338286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.338581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.338858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.339555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.341812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.375305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 943/1883] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:10 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:10.380852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.397771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2aadff-75a7-43a8-a782-90ebcfd7e53d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.469772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.470446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.470728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.471004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.471669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.474314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.510220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 941/1884] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:10 2022] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:10.519405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.547611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5627b8-3692-4360-ad2c-8c904503465c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.570571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.571865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.572351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.572962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.574155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.591610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.616177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 944/1885] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:10.619189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.632483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ccf5e1-5ed7-4112-abfd-aa2d68c72307 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.641374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f61f1-878f-4947-bd89-733bf35613f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.643193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f61f1-878f-4947-bd89-733bf35613f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.643579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f61f1-878f-4947-bd89-733bf35613f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.643945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f61f1-878f-4947-bd89-733bf35613f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.644657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f61f1-878f-4947-bd89-733bf35613f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.646401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f61f1-878f-4947-bd89-733bf35613f7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.667240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 942/1886] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:10.668452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.679279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42463d48-35f5-48c0-86f0-c4cea0f313e9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.685107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.686456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.687031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.687031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] PATH_INFO: `/v3/projects/0caf9b039b634259bace8ccc66fbcec8/users/ae7ef8caee764706b20b5460c10a12f1/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.712789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0caf9b039b634259bace8ccc66fbcec8, user_id=ae7ef8caee764706b20b5460c10a12f1, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.715728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.732723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 945/1887] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:10 2022] PUT /identity/v3/projects/0caf9b039b634259bace8ccc66fbcec8/users/ae7ef8caee764706b20b5460c10a12f1/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:10.738863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1e4ca-87d9-4a85-8d3a-00796e5d5c5f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.739202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1e4ca-87d9-4a85-8d3a-00796e5d5c5f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.739561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1e4ca-87d9-4a85-8d3a-00796e5d5c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.760358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-03a1e4ca-87d9-4a85-8d3a-00796e5d5c5f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:10.761623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-03a1e4ca-87d9-4a85-8d3a-00796e5d5c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.835501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 943/1888] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:10.846797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:10.849458 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:10.959220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a031-2f56-4e54-ab97-fdba0f100fd6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:10.965174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:10.966130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:10.966625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:10.967090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:10.978430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:10.979951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:10.992340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 946/1889] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:12.251309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64663840-d514-4350-99ab-cc9dd2b8c051 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.252299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64663840-d514-4350-99ab-cc9dd2b8c051 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.252546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64663840-d514-4350-99ab-cc9dd2b8c051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.311720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-64663840-d514-4350-99ab-cc9dd2b8c051 None None] MFA Rules not processed for user `ae7ef8caee764706b20b5460c10a12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:12.314119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-64663840-d514-4350-99ab-cc9dd2b8c051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:12.477392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:12.614884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 944/1890] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:12.620104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:12.658054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fea50-37e5-4fc7-aa5a-bb72bdc872b6 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:12.684241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:12.687767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.688955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.705768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.710096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:12.712937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:12.784389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 947/1891] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:12 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:12.790592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64663840-d514-4350-99ab-cc9dd2b8c051 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:12.812822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64663840-d514-4350-99ab-cc9dd2b8c051 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:12.930834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:12.932006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:12.932538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:12.933076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:12.934346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:12.938354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:12.982784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 945/1892] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:12 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:12.986729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:13.015851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70de4b-1504-44f7-b1d2-2adea8ccbf6a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:13.024931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:13.026156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.027044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.028057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.030761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:13.034467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:13.065057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 948/1893] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:13.070891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:13.105801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249b34-70a1-413c-ae86-b01853265c2c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:13.139176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:13.139176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.139176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.139176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] PATH_INFO: `/v3/projects/b76162fed119410b8c12f712f527199b/users/e2663d29cc1b436e98a60794a2b6b82b/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.159700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76162fed119410b8c12f712f527199b, user_id=e2663d29cc1b436e98a60794a2b6b82b, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:13.165300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:13.198082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 946/1894] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:13 2022] PUT /identity/v3/projects/b76162fed119410b8c12f712f527199b/users/e2663d29cc1b436e98a60794a2b6b82b/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:13.200734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:13.213227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa6422-db15-4158-92bd-3f1817662d3b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:13.254438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:13.324533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16353be-b4a0-4b02-829a-4480235252e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:13.325680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16353be-b4a0-4b02-829a-4480235252e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.327165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16353be-b4a0-4b02-829a-4480235252e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.327165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16353be-b4a0-4b02-829a-4480235252e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.329677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16353be-b4a0-4b02-829a-4480235252e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:13.332933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16353be-b4a0-4b02-829a-4480235252e0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:13.356570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 949/1895] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:13.363281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:13.379378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53cfc9-08ea-4416-8a24-e46029248b94 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:13.386040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4764307-2ccf-4993-8bc3-ae73bbe63c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:13.386769 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4764307-2ccf-4993-8bc3-ae73bbe63c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:13.387050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4764307-2ccf-4993-8bc3-ae73bbe63c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:13.387322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4764307-2ccf-4993-8bc3-ae73bbe63c17 admin admin] PATH_INFO: `/v3/projects/b76162fed119410b8c12f712f527199b/users/e2663d29cc1b436e98a60794a2b6b82b/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:13.389789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4764307-2ccf-4993-8bc3-ae73bbe63c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76162fed119410b8c12f712f527199b, user_id=e2663d29cc1b436e98a60794a2b6b82b, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:13.392613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4764307-2ccf-4993-8bc3-ae73bbe63c17 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:13.405719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 947/1896] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:13 2022] PUT /identity/v3/projects/b76162fed119410b8c12f712f527199b/users/e2663d29cc1b436e98a60794a2b6b82b/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:14.493117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.493746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.493925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.544217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] MFA Rules not processed for user `e2663d29cc1b436e98a60794a2b6b82b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:14.546310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.668077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 950/1897] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:14.679914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.680491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.680791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.722519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] MFA Rules not processed for user `ae7ef8caee764706b20b5460c10a12f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:14.724221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.733506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:14.736622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.859022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 948/1898] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:14.867698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f7058-f043-4538-be28-586bf56ab9b6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:14.872312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:14.874577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.875080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:14.876165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:14.876668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:14.877146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:14.880776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:14.973692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:14.975634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:14.977575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:14.991299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 951/1899] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:15.025990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c29ca8-b46f-4bca-ba6c-50d749506394 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:15.036745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d07f9b-381b-418c-94ef-a5534c3e16a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:15.037723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07f9b-381b-418c-94ef-a5534c3e16a6 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:15.038160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07f9b-381b-418c-94ef-a5534c3e16a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:15.038645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d07f9b-381b-418c-94ef-a5534c3e16a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:15.065211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07f9b-381b-418c-94ef-a5534c3e16a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:15.067559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d07f9b-381b-418c-94ef-a5534c3e16a6 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:15.083859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 949/1900] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:18.206856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.210363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:18.220783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:18.326323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833e018-67d2-4aec-8147-32f5fec33285 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.331742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.332858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.333359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.333856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] PATH_INFO: `/v3/users/4d7dfadc0f254a8186d4cff75c5d220e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.336056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7dfadc0f254a8186d4cff75c5d220e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.340015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.408114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7dfadc0f254a8186d4cff75c5d220e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:18.423290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7dfadc0f254a8186d4cff75c5d220e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:18.433308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7dfadc0f254a8186d4cff75c5d220e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:18.444538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7dfadc0f254a8186d4cff75c5d220e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:18.445461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7dfadc0f254a8186d4cff75c5d220e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:18.453107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 952/1901] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:18 2022] DELETE /identity/v3/users/4d7dfadc0f254a8186d4cff75c5d220e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:18.458221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.459153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.462750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.488444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:18.489836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:18.581312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 950/1902] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:18.600535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:18.602850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:18.720472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dc8e5-2d8d-4e8f-9074-fdb9b6a3b059 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:18.727091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:18.728207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:18.728501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:18.728951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:18.748480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:18.751380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:18.767307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 953/1903] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:19.328587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.330318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:19.347140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b26bc9-e368-4aca-a204-d8811f8a9d15 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.357549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.359386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.359907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.360432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] PATH_INFO: `/v3/projects/f654a4341f3f4e59ab9324a6605632fc` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.362823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f654a4341f3f4e59ab9324a6605632fc)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.367268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.464902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f654a4341f3f4e59ab9324a6605632fc', 'request_id': 'req-a994c555-3536-41cf-9de9-3ef16b13be35'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.480199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f654a4341f3f4e59ab9324a6605632fc', 'request_id': 'req-a994c555-3536-41cf-9de9-3ef16b13be35'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.495267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f654a4341f3f4e59ab9324a6605632fc', 'request_id': 'req-a994c555-3536-41cf-9de9-3ef16b13be35'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.521377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] The token cache is being invalidate because project f654a4341f3f4e59ab9324a6605632fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:19.521877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.523086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.525851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 951/1904] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:19 2022] DELETE /identity/v3/projects/f654a4341f3f4e59ab9324a6605632fc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:19.533489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:19.544102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b455b09-9ed0-4597-a974-a2990dd86526 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:19.569333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:19.641386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:19.642077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:19.642375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:19.642646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] PATH_INFO: `/v3/users/f82fe7ea8506495eab67d9120251af51` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:19.643961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f82fe7ea8506495eab67d9120251af51)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:19.646415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:19.730461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f82fe7ea8506495eab67d9120251af51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.760210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f82fe7ea8506495eab67d9120251af51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.774889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f82fe7ea8506495eab67d9120251af51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.789190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f82fe7ea8506495eab67d9120251af51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.790432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f82fe7ea8506495eab67d9120251af51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:19.802381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 954/1905] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:19 2022] DELETE /identity/v3/users/f82fe7ea8506495eab67d9120251af51 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:20.321506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:20.323955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:20.389403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994c555-3536-41cf-9de9-3ef16b13be35 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:20.486781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:20.504086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:20.505564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:20.506059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:20.506966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] PATH_INFO: `/v3/projects/3bbe577f862c44bdbe18981dbb1d2854` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:20.509355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bbe577f862c44bdbe18981dbb1d2854)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:20.512491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:20.646138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bbe577f862c44bdbe18981dbb1d2854', 'request_id': 'req-7ca33fec-e31f-47ef-be92-a6282293dd3d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.659127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bbe577f862c44bdbe18981dbb1d2854', 'request_id': 'req-7ca33fec-e31f-47ef-be92-a6282293dd3d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.677569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bbe577f862c44bdbe18981dbb1d2854', 'request_id': 'req-7ca33fec-e31f-47ef-be92-a6282293dd3d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.692031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] The token cache is being invalidate because project 3bbe577f862c44bdbe18981dbb1d2854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:20.692341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.693068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.698467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 952/1906] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:20 2022] DELETE /identity/v3/projects/3bbe577f862c44bdbe18981dbb1d2854 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:20.703866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:20.706520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:20.731997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647867d-03c6-4924-9f65-77c882f20c22 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:20.807543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:20.808261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:20.808608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:20.808960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] PATH_INFO: `/v3/users/c7457223f2b341599695bc6163807041` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:20.810555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7457223f2b341599695bc6163807041)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:20.812930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:20.881737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:20.883685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7457223f2b341599695bc6163807041'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.914722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7457223f2b341599695bc6163807041'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.925621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7457223f2b341599695bc6163807041'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.935746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7457223f2b341599695bc6163807041'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.936550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1aff8f39-47b5-41fa-8aac-b5c22716fac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7457223f2b341599695bc6163807041'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:20.946765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 955/1907] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:20 2022] DELETE /identity/v3/users/c7457223f2b341599695bc6163807041 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:21.569928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:21.572693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:21.616208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca33fec-e31f-47ef-be92-a6282293dd3d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:21.695077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:21.696204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:21.696610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:21.697951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] PATH_INFO: `/v3/projects/83a7856c99e047068cb49ce97f5fe95d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:21.699064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a7856c99e047068cb49ce97f5fe95d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:21.701376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:21.786400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a7856c99e047068cb49ce97f5fe95d', 'request_id': 'req-f40a441e-7501-4f8e-9022-884c6bd9a73b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:21.797631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a7856c99e047068cb49ce97f5fe95d', 'request_id': 'req-f40a441e-7501-4f8e-9022-884c6bd9a73b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:21.806319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a7856c99e047068cb49ce97f5fe95d', 'request_id': 'req-f40a441e-7501-4f8e-9022-884c6bd9a73b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:21.821280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] The token cache is being invalidate because project 83a7856c99e047068cb49ce97f5fe95d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:21.821627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:21.822455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f40a441e-7501-4f8e-9022-884c6bd9a73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:21.824037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 953/1908] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:21 2022] DELETE /identity/v3/projects/83a7856c99e047068cb49ce97f5fe95d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:21.831352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4866f4-a6fa-42a3-8540-12e743a9f05f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:21.832193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4866f4-a6fa-42a3-8540-12e743a9f05f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:21.832193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4866f4-a6fa-42a3-8540-12e743a9f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:21.881199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ae4866f4-a6fa-42a3-8540-12e743a9f05f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:21.882605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae4866f4-a6fa-42a3-8540-12e743a9f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:21.954390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 956/1909] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:21.969107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2cf8-d0d5-45f5-ab94-6a9c9ad24f1a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:21.969437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2cf8-d0d5-45f5-ab94-6a9c9ad24f1a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:21.969753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd2cf8-d0d5-45f5-ab94-6a9c9ad24f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:21.993009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d3cd2cf8-d0d5-45f5-ab94-6a9c9ad24f1a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:21.994312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d3cd2cf8-d0d5-45f5-ab94-6a9c9ad24f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:22.003095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 954/1910] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:22.007898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4866f4-a6fa-42a3-8540-12e743a9f05f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.018938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4866f4-a6fa-42a3-8540-12e743a9f05f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.023997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.024628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.024934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.025204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.025874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:22.026171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.027875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.050404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 957/1911] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:22.057668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd2cf8-d0d5-45f5-ab94-6a9c9ad24f1a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.075946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd2cf8-d0d5-45f5-ab94-6a9c9ad24f1a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.084389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.085468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.085952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.086489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.087681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.092509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.100996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:22.144993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 955/1912] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:22.149907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.162380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d407f1-c887-4a32-908d-1a44858846aa admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.248510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.248510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.248510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.248510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.248969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.254978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.295135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 958/1913] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:22.298207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.328560 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3d61f-b8bc-4e2c-b10c-0fe5bd2e18e8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.342394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.343780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.344518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.345304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.346797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.350662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.384526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 956/1914] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:22.392351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.424235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9f57d-3a7c-4ea4-b3b1-1e6a5a0de45b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.448248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd86cda-8b85-4827-b0d4-f29056b97558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.448924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd86cda-8b85-4827-b0d4-f29056b97558 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.449421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd86cda-8b85-4827-b0d4-f29056b97558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.449880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd86cda-8b85-4827-b0d4-f29056b97558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.451933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd86cda-8b85-4827-b0d4-f29056b97558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.455953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd86cda-8b85-4827-b0d4-f29056b97558 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.483839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 959/1915] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:22.489443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.519975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4d9c-9797-4181-8f53-b4a656544612 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.534315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.535465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.535926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.536497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] PATH_INFO: `/v3/projects/b97389afcfaa41e6bbd96dbd3bd98b62/users/396a88851b2b48ec812a992b32be1ba7/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.567079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97389afcfaa41e6bbd96dbd3bd98b62, user_id=396a88851b2b48ec812a992b32be1ba7, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.572670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.616450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 957/1916] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:22 2022] PUT /identity/v3/projects/b97389afcfaa41e6bbd96dbd3bd98b62/users/396a88851b2b48ec812a992b32be1ba7/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:22.639203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4b199-fe86-4b23-8d4c-ae4b69775495 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.639412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4b199-fe86-4b23-8d4c-ae4b69775495 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.639685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b4b199-fe86-4b23-8d4c-ae4b69775495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.681118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-64b4b199-fe86-4b23-8d4c-ae4b69775495 None None] MFA Rules not processed for user `396a88851b2b48ec812a992b32be1ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:22.687304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-64b4b199-fe86-4b23-8d4c-ae4b69775495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:22.687957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.689766 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:22.716346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:22.780959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910c1d-12a7-40ff-9f92-82bf5fefc343 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.786852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.787455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.787732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.788008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] PATH_INFO: `/v3/users/a311a677998a4700a81ec079f83b3bfa` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.789235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a311a677998a4700a81ec079f83b3bfa)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.791262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.808566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 960/1917] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:22.814280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4b199-fe86-4b23-8d4c-ae4b69775495 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.827784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b4b199-fe86-4b23-8d4c-ae4b69775495 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:22.832719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:22.833594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.833793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.834232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:22.835304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:22.837205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:22.901375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 961/1918] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:22.906887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:22.908310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a311a677998a4700a81ec079f83b3bfa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.937770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a311a677998a4700a81ec079f83b3bfa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.956366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a311a677998a4700a81ec079f83b3bfa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.958035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a311a677998a4700a81ec079f83b3bfa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.974825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3a70cd25-f0f4-4d9c-a80f-b22e4217ffd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a311a677998a4700a81ec079f83b3bfa'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:22.986175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 958/1919] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:22 2022] DELETE /identity/v3/users/a311a677998a4700a81ec079f83b3bfa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:22.992634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:22.993133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:22.993722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.031963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:23.034131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:23.041281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e472-dce8-4a98-8fe9-a6c3c35c9974 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.069219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:23.121107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 959/1920] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:23.134602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.136734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:23.148191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.149048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.149974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.149974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.150884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.153187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.188567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 962/1921] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:22 2022] POST /identity/v3/users => generated 296 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:23.190498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.192469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:23.210544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba4fb2-175e-4ba4-98f2-a60dbe7b138f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.219821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.220828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.221296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.221772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.222963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.226595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.240987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94f2af-81c2-4e9c-8f9e-c9ce0add1543 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.253480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 963/1922] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:23.255442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.255667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.257170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.257722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.258164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.284881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b987d-48f6-4d0d-ab59-c61cdac7929a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.287237 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.289088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.302091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.303115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.303560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.304051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] PATH_INFO: `/v3/projects/99dba64b50634c948162fbad6fc1954f/users/03f36be490e940d78766f314080743ba/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.307818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 960/1923] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:23.335630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dba64b50634c948162fbad6fc1954f, user_id=03f36be490e940d78766f314080743ba, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.341053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.354923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:23.365365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 964/1924] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:23 2022] PUT /identity/v3/projects/99dba64b50634c948162fbad6fc1954f/users/03f36be490e940d78766f314080743ba/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:23.374310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.394075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1176f-b9ca-47bc-bc3d-7a3f887c7c35 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.493162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22de66-eccc-4ff4-873c-885ee8c68433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.493971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22de66-eccc-4ff4-873c-885ee8c68433 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.494529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22de66-eccc-4ff4-873c-885ee8c68433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.494911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22de66-eccc-4ff4-873c-885ee8c68433 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.495691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22de66-eccc-4ff4-873c-885ee8c68433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.498343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22de66-eccc-4ff4-873c-885ee8c68433 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.520073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 961/1925] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:23.521807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.542084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97806bb1-baef-459e-a16f-1bd720f95026 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.554042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.555810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.557350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.557729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] PATH_INFO: `/v3/projects/99dba64b50634c948162fbad6fc1954f/users/03f36be490e940d78766f314080743ba/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.563319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dba64b50634c948162fbad6fc1954f, user_id=03f36be490e940d78766f314080743ba, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:23.569278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:23.601917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 965/1926] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:23 2022] PUT /identity/v3/projects/99dba64b50634c948162fbad6fc1954f/users/03f36be490e940d78766f314080743ba/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:23.615044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.615966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.615966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.691209 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] MFA Rules not processed for user `03f36be490e940d78766f314080743ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:23.693394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:23.839075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.843618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:23.851620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:23.884381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 962/1927] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:23.904672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:23.908127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:23.985206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2078d-c166-4282-8674-df87a6e1e60d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.993795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:23.994894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:23.995363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:23.995500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e911b2-4c99-422a-ac20-c1c3b386d28e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:23.995834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] PATH_INFO: `/v3/projects/81315cf0b82d4a72868e571172e379ae` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:23.998401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81315cf0b82d4a72868e571172e379ae)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.000784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:24.001616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:24.001947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:24.002102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.002449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:24.015122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.017416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.031811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 963/1928] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:24.116786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81315cf0b82d4a72868e571172e379ae', 'request_id': 'req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.151564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81315cf0b82d4a72868e571172e379ae', 'request_id': 'req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.159725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81315cf0b82d4a72868e571172e379ae', 'request_id': 'req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.186476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] The token cache is being invalidate because project 81315cf0b82d4a72868e571172e379ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:24.186981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.188314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.191169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 966/1929] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:23 2022] DELETE /identity/v3/projects/81315cf0b82d4a72868e571172e379ae => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:24.196764 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:24.217257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66651f65-257e-4fa8-a96e-e0f7329ea88f service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:24.313858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:24.314930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:24.315411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:24.315924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] PATH_INFO: `/v3/users/376fb0beab3a40168e6f6568b675f096` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:24.318078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376fb0beab3a40168e6f6568b675f096)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.321964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.395212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376fb0beab3a40168e6f6568b675f096'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.412332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376fb0beab3a40168e6f6568b675f096'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.424050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376fb0beab3a40168e6f6568b675f096'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.424842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376fb0beab3a40168e6f6568b675f096'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.448765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6a98ece0-688b-4903-b11d-4e397eef00a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376fb0beab3a40168e6f6568b675f096'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:24.461505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 964/1930] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:24 2022] DELETE /identity/v3/users/376fb0beab3a40168e6f6568b675f096 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:24.699390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:24.703973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:24.750878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adbb5f-6a1b-4dbb-b673-3864be3d8371 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:24.856323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:24.857793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:24.857793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:24.858510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] PATH_INFO: `/v3/users/396a88851b2b48ec812a992b32be1ba7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:24.859611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=396a88851b2b48ec812a992b32be1ba7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:24.861601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:24.884538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:24.962136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396a88851b2b48ec812a992b32be1ba7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.009783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396a88851b2b48ec812a992b32be1ba7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.025985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396a88851b2b48ec812a992b32be1ba7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.040867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396a88851b2b48ec812a992b32be1ba7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.041739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396a88851b2b48ec812a992b32be1ba7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.049570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 967/1931] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:24 2022] DELETE /identity/v3/users/396a88851b2b48ec812a992b32be1ba7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:25.054358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.054909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.054909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.083312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:25.085077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.107625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:25.148170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.149813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.188435 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 965/1932] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:25.204411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.206076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.280657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f6e4c-5b78-419b-b637-527a41e92651 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.287236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.288202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.288589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.288952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] PATH_INFO: `/v3/projects/f12522ef1c434901a040e6d5f2a01b91` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.290825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f12522ef1c434901a040e6d5f2a01b91)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.293326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.305899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3a637-c603-408c-95d9-2260e2ae6598 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.311311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cae12d-1188-429f-9875-26dfe9bb96cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.311948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cae12d-1188-429f-9875-26dfe9bb96cb service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.312226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cae12d-1188-429f-9875-26dfe9bb96cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.312501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cae12d-1188-429f-9875-26dfe9bb96cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.324307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cae12d-1188-429f-9875-26dfe9bb96cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.326289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cae12d-1188-429f-9875-26dfe9bb96cb service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.357621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 966/1933] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:25.378457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f12522ef1c434901a040e6d5f2a01b91', 'request_id': 'req-3d9773d5-f676-4f5d-8323-c83b6826e612'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.389897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f12522ef1c434901a040e6d5f2a01b91', 'request_id': 'req-3d9773d5-f676-4f5d-8323-c83b6826e612'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.398652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f12522ef1c434901a040e6d5f2a01b91', 'request_id': 'req-3d9773d5-f676-4f5d-8323-c83b6826e612'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.414106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] The token cache is being invalidate because project f12522ef1c434901a040e6d5f2a01b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:25.414593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.415405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3d9773d5-f676-4f5d-8323-c83b6826e612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:25.417727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 968/1934] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:25 2022] DELETE /identity/v3/projects/f12522ef1c434901a040e6d5f2a01b91 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:25.425814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765da8-48d6-4c0c-87ef-277053985d82 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.426099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765da8-48d6-4c0c-87ef-277053985d82 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.426410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765da8-48d6-4c0c-87ef-277053985d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.456603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-60765da8-48d6-4c0c-87ef-277053985d82 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:25.457917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-60765da8-48d6-4c0c-87ef-277053985d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.564164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 967/1935] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:25.572209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc941b4-2fea-4c40-8c5c-016804d42f3c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.572615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc941b4-2fea-4c40-8c5c-016804d42f3c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.572945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc941b4-2fea-4c40-8c5c-016804d42f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.630486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7fc941b4-2fea-4c40-8c5c-016804d42f3c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:25.631776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7fc941b4-2fea-4c40-8c5c-016804d42f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.657986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 969/1936] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:25.659200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765da8-48d6-4c0c-87ef-277053985d82 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.669523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765da8-48d6-4c0c-87ef-277053985d82 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.677529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.678783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.679246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.679586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.680379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:25.680753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.682567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.696633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 968/1937] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:25.701279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc941b4-2fea-4c40-8c5c-016804d42f3c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.712749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc941b4-2fea-4c40-8c5c-016804d42f3c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.718768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.719842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.720324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.720805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.721947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.725896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.754534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:25.786841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 970/1938] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/projects => generated 363 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:25.793745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.808188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:25.812435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:25.834926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e2cc6-d1b9-4cfc-8456-f9e6dff38956 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.946228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:25.966489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.969236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.969236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.969236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.969236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:25.970784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:25.987582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98263bd5-cb51-4f0b-8d6e-4ce56de85dfa admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:25.993669 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:25.994501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:25.998285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:25.998285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] PATH_INFO: `/v3/projects/b97389afcfaa41e6bbd96dbd3bd98b62` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:25.999548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97389afcfaa41e6bbd96dbd3bd98b62)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.003887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 969/1939] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:25 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:26.004590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.013258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.029561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8500ad-d99d-40be-9f54-e8df606372b8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.035054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.035577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.035856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.036131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.036801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.038467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.052375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 970/1940] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:26.058800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.076411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9fa0d-d8e2-4916-9344-7706944c4bee admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.084920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.085546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.085908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.086199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.087027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.089287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.102216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 971/1941] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:26.114152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.126318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd379db7-fab7-49ef-865d-f3fcce8af099 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.136694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97389afcfaa41e6bbd96dbd3bd98b62', 'request_id': 'req-c6d138fe-f8fa-4965-8136-e03ac7f968b9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.162326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97389afcfaa41e6bbd96dbd3bd98b62', 'request_id': 'req-c6d138fe-f8fa-4965-8136-e03ac7f968b9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.179365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97389afcfaa41e6bbd96dbd3bd98b62', 'request_id': 'req-c6d138fe-f8fa-4965-8136-e03ac7f968b9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.199630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] The token cache is being invalidate because project b97389afcfaa41e6bbd96dbd3bd98b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:26.200267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.201424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.204616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 971/1942] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:25 2022] DELETE /identity/v3/projects/b97389afcfaa41e6bbd96dbd3bd98b62 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:26.209768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.210462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a2591-3f9a-4931-ab13-20bf790301b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.211166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2591-3f9a-4931-ab13-20bf790301b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.211600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2591-3f9a-4931-ab13-20bf790301b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.211877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a2591-3f9a-4931-ab13-20bf790301b9 admin admin] PATH_INFO: `/v3/projects/0f35c2e42c164943be91067238bbb769/users/a5abaf3d88bc47c3b274b95fb93361d3/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.212789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:26.238686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d138fe-f8fa-4965-8136-e03ac7f968b9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.259993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.261275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.261863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.262475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] PATH_INFO: `/v3/users/03f36be490e940d78766f314080743ba` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.262823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a2591-3f9a-4931-ab13-20bf790301b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f35c2e42c164943be91067238bbb769, user_id=a5abaf3d88bc47c3b274b95fb93361d3, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.267035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f36be490e940d78766f314080743ba)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.271650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.276692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a2591-3f9a-4931-ab13-20bf790301b9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.313288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 972/1943] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:26 2022] PUT /identity/v3/projects/0f35c2e42c164943be91067238bbb769/users/a5abaf3d88bc47c3b274b95fb93361d3/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:26.333271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315b12-17e9-4c5a-a801-e3f725a5c753 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.333622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315b12-17e9-4c5a-a801-e3f725a5c753 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.334099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a315b12-17e9-4c5a-a801-e3f725a5c753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.381829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6a315b12-17e9-4c5a-a801-e3f725a5c753 None None] MFA Rules not processed for user `a5abaf3d88bc47c3b274b95fb93361d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:26.383350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6a315b12-17e9-4c5a-a801-e3f725a5c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:26.388881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f36be490e940d78766f314080743ba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.421761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f36be490e940d78766f314080743ba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.432257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f36be490e940d78766f314080743ba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.443297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f36be490e940d78766f314080743ba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.444191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f36be490e940d78766f314080743ba'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:26.445937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:26.453159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 972/1944] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:26 2022] DELETE /identity/v3/users/03f36be490e940d78766f314080743ba => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:26.480561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 973/1945] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:26.487730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.491034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:26.599762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e156ab9-9baa-414d-914b-a6e123e614cb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.605061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.605721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.605991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.606302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.608106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.610337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.650300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 973/1946] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:26.652660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a315b12-17e9-4c5a-a801-e3f725a5c753 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.708366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:26.775238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a315b12-17e9-4c5a-a801-e3f725a5c753 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.845530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.846339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.846718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.847019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.847698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.849666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.874504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 974/1947] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:26 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:26.880246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.896362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ea61c-c020-41d4-bb2d-0097d3dd0645 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.903165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.904937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.905305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.905580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.906497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:26.908225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:26.924402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 974/1948] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:26.931157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.963144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c43fe-c2c0-4e85-acb2-0046fc524d6a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:26.973869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:26.975197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:26.975782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:26.976525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] PATH_INFO: `/v3/projects/a3598ecdbe924185b58cc49cab302380/users/d19ea59bbf534c6695d651174490d38d/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:26.991690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:26.994920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.010767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae03e7e-51bd-40e5-8d6c-0385c867cc0b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.025286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.025943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.026219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.026520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] PATH_INFO: `/v3/projects/99dba64b50634c948162fbad6fc1954f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.027739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dba64b50634c948162fbad6fc1954f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.030384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.030936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3598ecdbe924185b58cc49cab302380, user_id=d19ea59bbf534c6695d651174490d38d, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.037146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.064497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 975/1949] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:26 2022] PUT /identity/v3/projects/a3598ecdbe924185b58cc49cab302380/users/d19ea59bbf534c6695d651174490d38d/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:27.068349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.093573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dba64b50634c948162fbad6fc1954f', 'request_id': 'req-a206e1ba-b5a0-4615-b274-7d98c33d5a12'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.104900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dba64b50634c948162fbad6fc1954f', 'request_id': 'req-a206e1ba-b5a0-4615-b274-7d98c33d5a12'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.117433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dba64b50634c948162fbad6fc1954f', 'request_id': 'req-a206e1ba-b5a0-4615-b274-7d98c33d5a12'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.132740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] The token cache is being invalidate because project 99dba64b50634c948162fbad6fc1954f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:27.133168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.134052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a206e1ba-b5a0-4615-b274-7d98c33d5a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:27.136053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 975/1950] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:26 2022] DELETE /identity/v3/projects/99dba64b50634c948162fbad6fc1954f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:27.150553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b775a-973b-4cf0-9988-17b5af2b1c78 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.150934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b775a-973b-4cf0-9988-17b5af2b1c78 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.151221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b775a-973b-4cf0-9988-17b5af2b1c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.165688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b425b0-1ffe-40a7-9358-7e3ce9a8ac1b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.178952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-536b775a-973b-4cf0-9988-17b5af2b1c78 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.181078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-536b775a-973b-4cf0-9988-17b5af2b1c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.241011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:27.259335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.260026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.260451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.260729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.261392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.263066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.269654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:27.278292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 976/1951] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:27.280124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.282109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.289299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 976/1952] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:27.296644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f89c2-e806-4ec4-b344-a309823f76a5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.297477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7b9d-8361-45d1-9476-3acb68459119 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.297765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7b9d-8361-45d1-9476-3acb68459119 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.298042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb7b9d-8361-45d1-9476-3acb68459119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.304543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ffd3c-bced-4c10-97ea-c83420a28536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.305915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ffd3c-bced-4c10-97ea-c83420a28536 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.306444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ffd3c-bced-4c10-97ea-c83420a28536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.306924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ffd3c-bced-4c10-97ea-c83420a28536 admin admin] PATH_INFO: `/v3/projects/a3598ecdbe924185b58cc49cab302380/users/d19ea59bbf534c6695d651174490d38d/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.324267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ffd3c-bced-4c10-97ea-c83420a28536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3598ecdbe924185b58cc49cab302380, user_id=d19ea59bbf534c6695d651174490d38d, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.338615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ffd3c-bced-4c10-97ea-c83420a28536 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.350756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-42bb7b9d-8361-45d1-9476-3acb68459119 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.352928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-42bb7b9d-8361-45d1-9476-3acb68459119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.385754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 977/1953] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:27 2022] PUT /identity/v3/projects/a3598ecdbe924185b58cc49cab302380/users/d19ea59bbf534c6695d651174490d38d/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:27.401203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.401542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.401827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.437823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] MFA Rules not processed for user `d19ea59bbf534c6695d651174490d38d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:27.439097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.473391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 977/1954] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:27.477394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7b9d-8361-45d1-9476-3acb68459119 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.491430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb7b9d-8361-45d1-9476-3acb68459119 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.496600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.497233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.497658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.497889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.498656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:27.498968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.500703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.517185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 978/1955] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:27.522199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.555521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfea0b-c4ce-4ddd-8d57-2acf42a5361e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.574385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 978/1956] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:27.574577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.574577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.575049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.575552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.578249 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.581998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.587264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.594280 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:27.634569 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 979/1957] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:27.641103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.693409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba948ecb-ab78-410c-952d-797c994ac5d1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.757843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8dbf5-9052-4231-bad5-6ed4897f3c86 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.766151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.767029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.767282 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.767467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.767789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.768345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.768514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.768849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.769353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.770345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.801943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 980/1958] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:27 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:27.808451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.810631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:27.830922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343010f-897f-4629-a848-8d3bfea8a40d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.838523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.839591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.840076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.840568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.841831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.845073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.863192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.864658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.865487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 981/1959] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:27.873051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.876486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 979/1960] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:27.892202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c473b-bd68-4c2e-b20e-f24fc40391a7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.902132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.903176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.903650 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.904499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.905630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.908114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.926390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 982/1961] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:27.932271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.945198 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b952f-4a97-4be7-afab-b338ed9da33a service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.953463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5b557-5aff-40b5-a3c6-ba043dde8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:27.954542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5b557-5aff-40b5-a3c6-ba043dde8c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:27.955032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5b557-5aff-40b5-a3c6-ba043dde8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:27.955357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5b557-5aff-40b5-a3c6-ba043dde8c9a admin admin] PATH_INFO: `/v3/projects/16cdecdfe58f453abdb841d74b0fe08d/users/2b4aeb5de648443d828cb3ef5cde9275/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:27.974206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5b557-5aff-40b5-a3c6-ba043dde8c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cdecdfe58f453abdb841d74b0fe08d, user_id=2b4aeb5de648443d828cb3ef5cde9275, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:27.975272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:27.977999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5b557-5aff-40b5-a3c6-ba043dde8c9a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:27.989316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d6513-0d2e-48a4-b257-7024edc71d01 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:27.996734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 980/1962] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:27 2022] PUT /identity/v3/projects/16cdecdfe58f453abdb841d74b0fe08d/users/2b4aeb5de648443d828cb3ef5cde9275/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:28.015957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.016286 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.016566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.044200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:28.066379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] MFA Rules not processed for user `2b4aeb5de648443d828cb3ef5cde9275`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:28.068892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.097606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.098199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.098654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.098996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.101255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.191585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 981/1963] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:28.207059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.208703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.224063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b2ebe-d534-49fd-9977-ab59381954bd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.236015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c85f0-bde5-4d65-8f86-ee976cf9fafc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.237858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c85f0-bde5-4d65-8f86-ee976cf9fafc service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.239112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.239589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c85f0-bde5-4d65-8f86-ee976cf9fafc service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.239969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c85f0-bde5-4d65-8f86-ee976cf9fafc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.241926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.264837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 983/1964] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:28.266737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c85f0-bde5-4d65-8f86-ee976cf9fafc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.269542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c85f0-bde5-4d65-8f86-ee976cf9fafc service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.291193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 982/1965] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:28.317904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.447677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53163-0591-4f4a-a0e6-35d485de001a service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.461835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.463283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.464900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.465788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] PATH_INFO: `/v3/users/2b4aeb5de648443d828cb3ef5cde9275` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.469011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4aeb5de648443d828cb3ef5cde9275)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.471247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.573052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4aeb5de648443d828cb3ef5cde9275'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.602914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4aeb5de648443d828cb3ef5cde9275'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.615238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4aeb5de648443d828cb3ef5cde9275'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.624541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4aeb5de648443d828cb3ef5cde9275'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.625549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4aeb5de648443d828cb3ef5cde9275'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:28.635886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 984/1966] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:28 2022] DELETE /identity/v3/users/2b4aeb5de648443d828cb3ef5cde9275 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:28.641102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.641483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.641774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.663362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:28.664599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.747395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 983/1967] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:28.758199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:28.759697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:28.766826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:28.831981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328b0ee-6cab-4a6e-bb77-0542649c64e0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:28.835855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38943a72-36d7-4cbd-95b6-fc77b34935e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:28.836521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943a72-36d7-4cbd-95b6-fc77b34935e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:28.836807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943a72-36d7-4cbd-95b6-fc77b34935e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:28.837077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38943a72-36d7-4cbd-95b6-fc77b34935e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:28.848703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38943a72-36d7-4cbd-95b6-fc77b34935e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:28.850336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38943a72-36d7-4cbd-95b6-fc77b34935e8 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:28.861790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 985/1968] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:29.213626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.216049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.234692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e0fee-907a-42c4-93af-8d47935a3fa6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.246412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.247335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.248520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.249974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] PATH_INFO: `/v3/projects/16cdecdfe58f453abdb841d74b0fe08d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.252113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cdecdfe58f453abdb841d74b0fe08d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.254784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.268789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:29.322643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cdecdfe58f453abdb841d74b0fe08d', 'request_id': 'req-f176ea00-95b0-4d7f-881d-9bb875815486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.339761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cdecdfe58f453abdb841d74b0fe08d', 'request_id': 'req-f176ea00-95b0-4d7f-881d-9bb875815486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.353133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cdecdfe58f453abdb841d74b0fe08d', 'request_id': 'req-f176ea00-95b0-4d7f-881d-9bb875815486'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.374665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] The token cache is being invalidate because project 16cdecdfe58f453abdb841d74b0fe08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:29.375130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.376289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f176ea00-95b0-4d7f-881d-9bb875815486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:29.382583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 984/1969] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:29 2022] DELETE /identity/v3/projects/16cdecdfe58f453abdb841d74b0fe08d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:29.385247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848a29-d15a-4eed-8e6e-0260d67ae581 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.385851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848a29-d15a-4eed-8e6e-0260d67ae581 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.387291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43848a29-d15a-4eed-8e6e-0260d67ae581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.427437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-43848a29-d15a-4eed-8e6e-0260d67ae581 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:29.430293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-43848a29-d15a-4eed-8e6e-0260d67ae581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.517207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 986/1970] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:29.526539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf14f0a-e1fc-4ae1-94ee-0932df48dc49 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.526831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf14f0a-e1fc-4ae1-94ee-0932df48dc49 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.527113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf14f0a-e1fc-4ae1-94ee-0932df48dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.559449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ccf14f0a-e1fc-4ae1-94ee-0932df48dc49 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:29.560727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ccf14f0a-e1fc-4ae1-94ee-0932df48dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:29.583313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 985/1971] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:29.595533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848a29-d15a-4eed-8e6e-0260d67ae581 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.618287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43848a29-d15a-4eed-8e6e-0260d67ae581 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.626406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.627368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.627750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.628133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.629346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:29.629827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.631826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.673018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 987/1972] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:29.680105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf14f0a-e1fc-4ae1-94ee-0932df48dc49 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.699459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf14f0a-e1fc-4ae1-94ee-0932df48dc49 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.708641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.709337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.709624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.709980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.710875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.710875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.777363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 986/1973] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:29.784371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:29.800898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fa03f-2c17-4173-a029-6aab90268dd0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:29.908892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:29.910115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:29.911406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:29.912889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:29.913032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:29.917166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:29.995620 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 988/1974] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:29 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:30.008275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.024232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026512c0-e376-4f85-9836-45f57452d2af admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.031988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.032691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.033043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.033400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.034170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.036066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.070990 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 987/1975] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:30.071598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.086016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918596d-fc42-4187-89e9-b12117b40b32 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.092397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d2a62-0706-4241-82d5-94887acfa1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.093031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2a62-0706-4241-82d5-94887acfa1ff admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.093481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2a62-0706-4241-82d5-94887acfa1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.093803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d2a62-0706-4241-82d5-94887acfa1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.094505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2a62-0706-4241-82d5-94887acfa1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.096389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d2a62-0706-4241-82d5-94887acfa1ff admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.109807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 989/1976] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:30.114845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.128687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f45aa-0a9d-44dc-9ecd-71fce5765735 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.135700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.136624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.137283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.137563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] PATH_INFO: `/v3/projects/e4476ba95dd347159c5ed29ef9b95ff5/users/7f707a0f4855453e838a19893530cb13/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.156787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4476ba95dd347159c5ed29ef9b95ff5, user_id=7f707a0f4855453e838a19893530cb13, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.159916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.175669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 988/1977] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:30 2022] PUT /identity/v3/projects/e4476ba95dd347159c5ed29ef9b95ff5/users/7f707a0f4855453e838a19893530cb13/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:30.190657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6ad4-67fc-4f0f-a3e6-4fdf5eab3893 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.191093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6ad4-67fc-4f0f-a3e6-4fdf5eab3893 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.191657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda6ad4-67fc-4f0f-a3e6-4fdf5eab3893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.237250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.250232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-eeda6ad4-67fc-4f0f-a3e6-4fdf5eab3893 None None] MFA Rules not processed for user `7f707a0f4855453e838a19893530cb13`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:30.255101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-eeda6ad4-67fc-4f0f-a3e6-4fdf5eab3893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:30.432796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 990/1978] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:30.433985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.518422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd0189-f65e-4138-84e7-1577913dfd93 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.523339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.523967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.524242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.524512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.525197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.527324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.564995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 989/1979] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:30 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:30.567341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda6ad4-67fc-4f0f-a3e6-4fdf5eab3893 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.580355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda6ad4-67fc-4f0f-a3e6-4fdf5eab3893 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.678007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.678719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.679007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.679278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.679991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.682013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.713362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 991/1980] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:30 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:30.717762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.729408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f0330-9d1f-473e-8401-a9e120333534 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.735515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.736167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.736426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.736697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.737356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.739041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.752285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 990/1981] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:30.758553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.769284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646118c4-dca5-4303-8fdb-1ca7f2c1eec1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.775312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.775984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.776267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.776540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] PATH_INFO: `/v3/projects/1e5d1c76cd86472ea0d240ec628c1038/users/8b78343c03504da49c2f6b585ee9c9c9/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.797416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5d1c76cd86472ea0d240ec628c1038, user_id=8b78343c03504da49c2f6b585ee9c9c9, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.800414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.823750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 992/1982] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:30 2022] PUT /identity/v3/projects/1e5d1c76cd86472ea0d240ec628c1038/users/8b78343c03504da49c2f6b585ee9c9c9/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:30.828661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:30.847792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adb559-8edb-4a00-848f-8fdc3e9c4f9b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:30.856027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:30.948484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01595d6-b09b-407c-99d3-dfd9231cd9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:30.949689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01595d6-b09b-407c-99d3-dfd9231cd9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:30.950231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01595d6-b09b-407c-99d3-dfd9231cd9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:30.950777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01595d6-b09b-407c-99d3-dfd9231cd9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:30.952740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01595d6-b09b-407c-99d3-dfd9231cd9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:30.956154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01595d6-b09b-407c-99d3-dfd9231cd9c6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:30.977408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 991/1983] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:30.985541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.005910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d7c21-0601-41c9-9799-91a763926809 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.014968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.016334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.017220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.017880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] PATH_INFO: `/v3/projects/1e5d1c76cd86472ea0d240ec628c1038/users/8b78343c03504da49c2f6b585ee9c9c9/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.022918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5d1c76cd86472ea0d240ec628c1038, user_id=8b78343c03504da49c2f6b585ee9c9c9, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.028480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.052502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 993/1984] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:30 2022] PUT /identity/v3/projects/1e5d1c76cd86472ea0d240ec628c1038/users/8b78343c03504da49c2f6b585ee9c9c9/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:31.072833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.073324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.073773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.115895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] MFA Rules not processed for user `8b78343c03504da49c2f6b585ee9c9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:31.117163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:31.214290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 992/1985] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:31.224140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.225935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:31.287871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308c496-451d-4561-832b-c208e921f335 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.291671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b9442-a9b7-4d58-a637-50a38910675d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.292301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b9442-a9b7-4d58-a637-50a38910675d service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.292580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b9442-a9b7-4d58-a637-50a38910675d service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.292850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b9442-a9b7-4d58-a637-50a38910675d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.298692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:31.366094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b9442-a9b7-4d58-a637-50a38910675d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.367795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b9442-a9b7-4d58-a637-50a38910675d service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.379395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 994/1986] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:31.588080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:31.595935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:31.776680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd25703-afac-4c71-927b-29f7809bdec2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:31.783760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:31.784798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.785324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.785771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] PATH_INFO: `/v3/users/a5abaf3d88bc47c3b274b95fb93361d3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.787623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5abaf3d88bc47c3b274b95fb93361d3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:31.790192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:31.844488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:31.868181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5abaf3d88bc47c3b274b95fb93361d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:31.885879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5abaf3d88bc47c3b274b95fb93361d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:31.898501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5abaf3d88bc47c3b274b95fb93361d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:31.899295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5abaf3d88bc47c3b274b95fb93361d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:31.909228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5abaf3d88bc47c3b274b95fb93361d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:31.917495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 993/1987] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:31 2022] DELETE /identity/v3/users/a5abaf3d88bc47c3b274b95fb93361d3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:31.927893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:31.928731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:31.928731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:31.954663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:31.956471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:32.059257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 995/1988] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:32.070281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.071885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:32.140775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad4c29-cd01-4d80-8003-4cfa11535882 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.145013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.145667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.145942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.146213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.156921 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.158460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.171116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 994/1989] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:32.537600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.539178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:32.552872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca83b8-4cfd-4b24-99a7-475fc54cbb87 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.558593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.559673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.560148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.560625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] PATH_INFO: `/v3/projects/0f35c2e42c164943be91067238bbb769` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.562668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f35c2e42c164943be91067238bbb769)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.567364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.657596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f35c2e42c164943be91067238bbb769', 'request_id': 'req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.667428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f35c2e42c164943be91067238bbb769', 'request_id': 'req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.679296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f35c2e42c164943be91067238bbb769', 'request_id': 'req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.695227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] The token cache is being invalidate because project 0f35c2e42c164943be91067238bbb769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:32.695519 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.696209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.697752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 996/1990] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:32 2022] DELETE /identity/v3/projects/0f35c2e42c164943be91067238bbb769 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:32.702569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:32.714592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80707ee-0aa9-4297-b80f-943c92623b59 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:32.784261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:32.785552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:32.786373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:32.787262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] PATH_INFO: `/v3/users/d19ea59bbf534c6695d651174490d38d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:32.789824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19ea59bbf534c6695d651174490d38d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:32.794777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:32.860481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19ea59bbf534c6695d651174490d38d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.866139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:32.880821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19ea59bbf534c6695d651174490d38d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.894560 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19ea59bbf534c6695d651174490d38d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.895469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19ea59bbf534c6695d651174490d38d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.906126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-efee495f-9e67-4803-b507-e41805cddacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19ea59bbf534c6695d651174490d38d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:32.914299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 995/1991] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:32 2022] DELETE /identity/v3/users/d19ea59bbf534c6695d651174490d38d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:33.326924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:33.330322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:33.355744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fec5d-d740-4be5-aff5-3e31d1bf246a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:33.393940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:33.454914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:33.455587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.455932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.456562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] PATH_INFO: `/v3/projects/a3598ecdbe924185b58cc49cab302380` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.459873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3598ecdbe924185b58cc49cab302380)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:33.461973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:33.567008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3598ecdbe924185b58cc49cab302380', 'request_id': 'req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:33.582817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3598ecdbe924185b58cc49cab302380', 'request_id': 'req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:33.593193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3598ecdbe924185b58cc49cab302380', 'request_id': 'req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:33.615331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] The token cache is being invalidate because project a3598ecdbe924185b58cc49cab302380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:33.615685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:33.616408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-51fe48fd-3ae9-4e22-b1f2-0a790cc162ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:33.618122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 997/1992] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:33 2022] DELETE /identity/v3/projects/a3598ecdbe924185b58cc49cab302380 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:33.624031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d298-cd34-45db-9b95-5c3be827e305 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.624248 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d298-cd34-45db-9b95-5c3be827e305 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.624522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d298-cd34-45db-9b95-5c3be827e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.645438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b926d298-cd34-45db-9b95-5c3be827e305 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:33.646720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b926d298-cd34-45db-9b95-5c3be827e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:33.712455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 996/1993] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:33.724526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43748d-dab9-49fc-b96d-71d768dc111b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.726466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43748d-dab9-49fc-b96d-71d768dc111b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.726870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43748d-dab9-49fc-b96d-71d768dc111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.754999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4a43748d-dab9-49fc-b96d-71d768dc111b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:33.756462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4a43748d-dab9-49fc-b96d-71d768dc111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:33.766736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 998/1994] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:33.772771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d298-cd34-45db-9b95-5c3be827e305 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:33.783572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d298-cd34-45db-9b95-5c3be827e305 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:33.788436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:33.789052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.789334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.789610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.790306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:33.790612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:33.792231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:33.805656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 997/1995] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:33.810666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43748d-dab9-49fc-b96d-71d768dc111b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:33.820664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43748d-dab9-49fc-b96d-71d768dc111b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:33.825513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:33.826548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.826927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.827206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.827880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:33.829822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:33.861187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 999/1996] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:33 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:33.865767 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:33.877911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36ea47-b8d8-4dd9-a4e4-6566dc4440aa admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:33.940810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:33.941430 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.941710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.942038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.942730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:33.944670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:33.971260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 998/1997] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:33 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:33.974819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:33.986191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e92560-a6b0-4cd4-889b-1569a7f996f7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:33.991037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:33.991661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:33.991943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:33.992219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:33.992882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:33.994559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.005500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1000/1998] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:34.011330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.024517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad08da6-d069-4387-aa65-8cb656c47302 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.031218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ace88-d420-473e-97bc-4e9a660e712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.031988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ace88-d420-473e-97bc-4e9a660e712c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.032370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ace88-d420-473e-97bc-4e9a660e712c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.032745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ace88-d420-473e-97bc-4e9a660e712c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.033504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ace88-d420-473e-97bc-4e9a660e712c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.035462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ace88-d420-473e-97bc-4e9a660e712c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.049259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 999/1999] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:34.053985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.071088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fa0ec-0d00-409e-a022-6312a2e9be38 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.076882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.077792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.078190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.078532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] PATH_INFO: `/v3/projects/a156dcaf7b0046a9a21551eb1fe7e9d7/users/5c9ef8b27209452ead43c2d7edca3ac2/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.098710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a156dcaf7b0046a9a21551eb1fe7e9d7, user_id=5c9ef8b27209452ead43c2d7edca3ac2, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.103825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.124973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1001/2000] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:34 2022] PUT /identity/v3/projects/a156dcaf7b0046a9a21551eb1fe7e9d7/users/5c9ef8b27209452ead43c2d7edca3ac2/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:34.144246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.145646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.145646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.192610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] MFA Rules not processed for user `5c9ef8b27209452ead43c2d7edca3ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:34.195160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:34.239981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:34.286735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1000/2001] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:34.291362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.362800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:34.366735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca9584-13bd-4987-abfb-8e4af3b1d1f9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.373523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.374321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.374682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.375327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.376201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.378434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.386460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.389819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:34.410256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1002/2002] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:34 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:34.411490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02561eb7-3a95-463f-9c8b-01147ed85d3f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.414185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.487634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.488395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.488678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.488963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] PATH_INFO: `/v3/users/7f707a0f4855453e838a19893530cb13` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.490133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f707a0f4855453e838a19893530cb13)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.492135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.498288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc0d36-ff53-47d7-86a6-3479e2a4f593 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.503341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.504102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.504386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.504661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.505305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.507656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.544296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1003/2003] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:34 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:34.548693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.555603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f707a0f4855453e838a19893530cb13'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:34.559023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81d899-2cd2-4f26-b7c9-4a52fdf9e1ad admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.565028 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.565665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.565947 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.566228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.566913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.568689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.572635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f707a0f4855453e838a19893530cb13'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:34.581684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f707a0f4855453e838a19893530cb13'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:34.581877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1004/2004] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:34.582781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f707a0f4855453e838a19893530cb13'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:34.587937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.597007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-194ddd09-de7a-422b-9cbe-2d93a1b5da75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f707a0f4855453e838a19893530cb13'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:34.610180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1001/2005] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:34 2022] DELETE /identity/v3/users/7f707a0f4855453e838a19893530cb13 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:34.611722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.612131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.612395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.617296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b3d86-91be-493a-b272-1292d4dd6e8d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.655949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:34.657554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:34.734539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:34.762322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1002/2006] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:34.768223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.769647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.770205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.770800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] PATH_INFO: `/v3/projects/6c16d21eeb464eeebf93eaec49d70765/users/a1c34cddc647464eb55a86f7da8b94fc/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.777230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.779969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:34.798129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c16d21eeb464eeebf93eaec49d70765, user_id=a1c34cddc647464eb55a86f7da8b94fc, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.802665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.823121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1005/2007] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:34 2022] PUT /identity/v3/projects/6c16d21eeb464eeebf93eaec49d70765/users/a1c34cddc647464eb55a86f7da8b94fc/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:34.828471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.831266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:34.862520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785469-cefe-49ac-8f1a-6506251c0ab8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.894740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:34.918779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b13f5-4606-44d6-8113-e874adb3ac82 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.928106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.928830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.929216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.930358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.930358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.934327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.954716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1006/2008] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:34.959265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:34.970594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52364e22-4626-4a77-9c1c-3f3c6f0dbc5b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:34.975996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525b30-cdcb-44b2-802c-2d1c091ccb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.976915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525b30-cdcb-44b2-802c-2d1c091ccb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.977231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525b30-cdcb-44b2-802c-2d1c091ccb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.977611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525b30-cdcb-44b2-802c-2d1c091ccb7d admin admin] PATH_INFO: `/v3/projects/6c16d21eeb464eeebf93eaec49d70765/users/a1c34cddc647464eb55a86f7da8b94fc/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.978228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:34.978887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:34.979168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:34.979443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:34.980420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525b30-cdcb-44b2-802c-2d1c091ccb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c16d21eeb464eeebf93eaec49d70765, user_id=a1c34cddc647464eb55a86f7da8b94fc, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.983607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525b30-cdcb-44b2-802c-2d1c091ccb7d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.990339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:34.991866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:34.996679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1007/2009] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:34 2022] PUT /identity/v3/projects/6c16d21eeb464eeebf93eaec49d70765/users/a1c34cddc647464eb55a86f7da8b94fc/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:35.005212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1003/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:35.008288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:35.008762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:35.009400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:35.072241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] MFA Rules not processed for user `a1c34cddc647464eb55a86f7da8b94fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:35.074455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:35.186936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1008/2011] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:35.211394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:35.213114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:35.290857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478723b-9b2b-4b8c-ab8c-b906d41ffe0c service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:35.360781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:35.362040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:35.362654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:35.363104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:35.387412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:35.400880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:35.416387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1004/2012] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:35.424807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:35.427017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:35.499158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:35.503923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:35.556697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f913-b3b5-4b29-8789-7b76bb7f45ae None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:35.563173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:35.563834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:35.564134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:35.564523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] PATH_INFO: `/v3/projects/e4476ba95dd347159c5ed29ef9b95ff5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:35.566558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4476ba95dd347159c5ed29ef9b95ff5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:35.570128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:35.627695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11640a30-d13d-49da-beb2-e4c1f32a3c31 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:35.633622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:35.635705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:35.636026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:35.636263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] PATH_INFO: `/v3/users/5c9ef8b27209452ead43c2d7edca3ac2` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:35.637754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9ef8b27209452ead43c2d7edca3ac2)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:35.640933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:35.654568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4476ba95dd347159c5ed29ef9b95ff5', 'request_id': 'req-2161631b-95ab-4100-be9d-ba58689dc511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.663118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:35.668465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4476ba95dd347159c5ed29ef9b95ff5', 'request_id': 'req-2161631b-95ab-4100-be9d-ba58689dc511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.684381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4476ba95dd347159c5ed29ef9b95ff5', 'request_id': 'req-2161631b-95ab-4100-be9d-ba58689dc511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.726717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9ef8b27209452ead43c2d7edca3ac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.730187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] The token cache is being invalidate because project e4476ba95dd347159c5ed29ef9b95ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:35.730824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.733758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.738049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1009/2013] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:35 2022] DELETE /identity/v3/projects/e4476ba95dd347159c5ed29ef9b95ff5 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:35.743982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:35.748356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:35.751142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9ef8b27209452ead43c2d7edca3ac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.761908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9ef8b27209452ead43c2d7edca3ac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.762928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9ef8b27209452ead43c2d7edca3ac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.774001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-82a8a04b-4b83-41f8-aefc-bc6b0c5df0a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9ef8b27209452ead43c2d7edca3ac2'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:35.812712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1005/2014] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:35 2022] DELETE /identity/v3/users/5c9ef8b27209452ead43c2d7edca3ac2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:35.812712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:35.812712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:35.812712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:35.847082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:35.848365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:35.895812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161631b-95ab-4100-be9d-ba58689dc511 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:35.940467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1006/2015] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:35.962296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:35.964165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:35.980084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:35.980782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:35.981061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:35.981335 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] PATH_INFO: `/v3/users/8b78343c03504da49c2f6b585ee9c9c9` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:35.983417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b78343c03504da49c2f6b585ee9c9c9)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:35.985581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:36.002943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:36.056203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1ebe5-bfdb-4df0-b39e-966e63a8c349 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:36.061798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:36.062932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:36.063470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:36.064062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:36.075370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:36.076090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b78343c03504da49c2f6b585ee9c9c9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.077555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:36.089403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1007/2016] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:36.090401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b78343c03504da49c2f6b585ee9c9c9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.100850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b78343c03504da49c2f6b585ee9c9c9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.111574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b78343c03504da49c2f6b585ee9c9c9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.112536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b78343c03504da49c2f6b585ee9c9c9'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.121137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1010/2017] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:35 2022] DELETE /identity/v3/users/8b78343c03504da49c2f6b585ee9c9c9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:36.495303 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:36.497167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:36.502903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:36.505129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:36.527832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:36.546589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23503316-f9de-4ffc-963c-582e841af472 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:36.680622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117fb04-f243-4e9c-8cc6-74efa8673c33 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:36.688635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:36.689459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:36.689738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:36.690007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] PATH_INFO: `/v3/projects/a156dcaf7b0046a9a21551eb1fe7e9d7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:36.691675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a156dcaf7b0046a9a21551eb1fe7e9d7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:36.693617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:36.735941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:36.736687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:36.736969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:36.737299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] PATH_INFO: `/v3/projects/1e5d1c76cd86472ea0d240ec628c1038` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:36.739119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5d1c76cd86472ea0d240ec628c1038)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:36.741681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:36.772471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a156dcaf7b0046a9a21551eb1fe7e9d7', 'request_id': 'req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.788655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a156dcaf7b0046a9a21551eb1fe7e9d7', 'request_id': 'req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.801334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a156dcaf7b0046a9a21551eb1fe7e9d7', 'request_id': 'req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.821255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] The token cache is being invalidate because project a156dcaf7b0046a9a21551eb1fe7e9d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:36.821593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.822924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.826812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1011/2018] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:36 2022] DELETE /identity/v3/projects/a156dcaf7b0046a9a21551eb1fe7e9d7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:36.829654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:36.831360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:36.833592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5d1c76cd86472ea0d240ec628c1038', 'request_id': 'req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.846156 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5d1c76cd86472ea0d240ec628c1038', 'request_id': 'req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.856001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5d1c76cd86472ea0d240ec628c1038', 'request_id': 'req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.886618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] The token cache is being invalidate because project 1e5d1c76cd86472ea0d240ec628c1038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:36.886946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.888227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ba70d5ec-37ec-4774-b94e-91c6a8971dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:36.891634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1008/2019] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:36 2022] DELETE /identity/v3/projects/1e5d1c76cd86472ea0d240ec628c1038 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:36.899442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c199b-e62e-4b8a-ac5e-3008d2e42333 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:36.900081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c199b-e62e-4b8a-ac5e-3008d2e42333 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:36.900578 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c199b-e62e-4b8a-ac5e-3008d2e42333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:36.918786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8683e-d8e4-43ba-8dd3-be3c7c22a82d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:36.930123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6d9c199b-e62e-4b8a-ac5e-3008d2e42333 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:36.931390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6d9c199b-e62e-4b8a-ac5e-3008d2e42333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.019021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:37.030581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:37.048311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1009/2020] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:37.050903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09bdf-70c2-45a2-968a-a2b053a777dd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.051645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09bdf-70c2-45a2-968a-a2b053a777dd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.052259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b09bdf-70c2-45a2-968a-a2b053a777dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.058422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.059478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.060009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.060480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] PATH_INFO: `/v3/users/a1c34cddc647464eb55a86f7da8b94fc` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.062554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c34cddc647464eb55a86f7da8b94fc)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.067709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.078183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-53b09bdf-70c2-45a2-968a-a2b053a777dd None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:37.079494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-53b09bdf-70c2-45a2-968a-a2b053a777dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.092580 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1010/2021] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:37.097055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09bdf-70c2-45a2-968a-a2b053a777dd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.108429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b09bdf-70c2-45a2-968a-a2b053a777dd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.115001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.115699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.115979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.116391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.117134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:37.117441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.119937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.137470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c34cddc647464eb55a86f7da8b94fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.143487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1011/2022] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:37.145415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.157897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81e274-08b6-4404-9370-2ab84bff8b0e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.161263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c34cddc647464eb55a86f7da8b94fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.162827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.163655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.163942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.164213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.164879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.166847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.171480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c34cddc647464eb55a86f7da8b94fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.181249 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c34cddc647464eb55a86f7da8b94fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.182320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c34cddc647464eb55a86f7da8b94fc'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.191590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1012/2023] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:36 2022] DELETE /identity/v3/users/a1c34cddc647464eb55a86f7da8b94fc => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:37.237973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1012/2024] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:37.238404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.239994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.365344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794ded3-d6dd-4f56-b320-9059666e23dd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.457215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.457851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.458131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.458489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.459297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.461540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.506037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1013/2025] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:37.509168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.522382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913563-0c9c-44a1-b718-12c56628331f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.535116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.535918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.536500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.536500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.538618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.540223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.551104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.555736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.560900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1013/2026] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:37.562070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.571213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:37.574641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008955b-1c51-49fe-ad39-aa7404f9d00b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.581243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.581875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.581985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10bda5-e3a8-46c7-8e8d-b0526a08e659 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.582353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.582633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.583313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.585033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.603523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.604683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.605176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.605739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] PATH_INFO: `/v3/projects/6c16d21eeb464eeebf93eaec49d70765` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.608451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c16d21eeb464eeebf93eaec49d70765)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.611676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.613449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1014/2027] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:37.618414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.629962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21892-1036-413f-b523-6aff83e99423 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.636754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc286e3-91ad-4454-bf7c-a24a9a6b9917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.637826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc286e3-91ad-4454-bf7c-a24a9a6b9917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.638930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc286e3-91ad-4454-bf7c-a24a9a6b9917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.639433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc286e3-91ad-4454-bf7c-a24a9a6b9917 admin admin] PATH_INFO: `/v3/projects/64dd4ee3294f437fb414eec4ba93725d/users/67a55c97f13e4d2f86f009d1a135f7e8/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.682293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c16d21eeb464eeebf93eaec49d70765', 'request_id': 'req-6545bafa-49ff-4375-9591-045f12797605'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.695662 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c16d21eeb464eeebf93eaec49d70765', 'request_id': 'req-6545bafa-49ff-4375-9591-045f12797605'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.701609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc286e3-91ad-4454-bf7c-a24a9a6b9917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64dd4ee3294f437fb414eec4ba93725d, user_id=67a55c97f13e4d2f86f009d1a135f7e8, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.710793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc286e3-91ad-4454-bf7c-a24a9a6b9917 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.719260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c16d21eeb464eeebf93eaec49d70765', 'request_id': 'req-6545bafa-49ff-4375-9591-045f12797605'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.742605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1015/2028] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:37 2022] PUT /identity/v3/projects/64dd4ee3294f437fb414eec4ba93725d/users/67a55c97f13e4d2f86f009d1a135f7e8/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:37.743296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] The token cache is being invalidate because project 6c16d21eeb464eeebf93eaec49d70765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:37.743911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.745080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6545bafa-49ff-4375-9591-045f12797605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:37.748866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1014/2029] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:37 2022] DELETE /identity/v3/projects/6c16d21eeb464eeebf93eaec49d70765 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:37.753825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.754339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.754693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.756901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb854af-ef1b-4e21-b191-ee6f4e58d033 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.757316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb854af-ef1b-4e21-b191-ee6f4e58d033 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.757799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb854af-ef1b-4e21-b191-ee6f4e58d033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.786971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bbb854af-ef1b-4e21-b191-ee6f4e58d033 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:37.788474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bbb854af-ef1b-4e21-b191-ee6f4e58d033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.807861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] MFA Rules not processed for user `67a55c97f13e4d2f86f009d1a135f7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:37.809339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.883745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1015/2030] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:37.897604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20f114-4486-4f98-bb00-bec6aa1c049b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.898274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20f114-4486-4f98-bb00-bec6aa1c049b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.898551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20f114-4486-4f98-bb00-bec6aa1c049b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.922155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1016/2031] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:37.927050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.928500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.935621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8b20f114-4486-4f98-bb00-bec6aa1c049b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:37.936853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8b20f114-4486-4f98-bb00-bec6aa1c049b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:37.945212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bea88-0f25-44a2-b72a-e0b8eac1868f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.947155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1016/2032] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:37.951773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20f114-4486-4f98-bb00-bec6aa1c049b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:37.954549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.955462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.955755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.956001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.956678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.960101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:37.963959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20f114-4486-4f98-bb00-bec6aa1c049b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:37.970371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:37.971158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:37.971440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:37.971713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:37.972386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:37.982863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:37.985890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.003131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1017/2033] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:37 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:38.009376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.020911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1017/2034] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:38.021916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.034269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29590e2f-323f-46a2-bd0c-64553abe3b99 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.090699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:38.133616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.134630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.135730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.136187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.137019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.139757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.178900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea0084-7b53-4872-a5d5-e34e60e6f0db admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.180598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:38.203385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1018/2035] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:38.204058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.205153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.205637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.206579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.207477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.208201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.210268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.244546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1018/2036] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:38.248125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.267738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aab6c-206b-4e40-b7b8-5fffc146a9bd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.290392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e73ee-f6fe-4cf9-80d3-fd0e99ce7836 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.296354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.296968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.297247 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.297516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.298151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.300127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.328510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1019/2037] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:38.329735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.335707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.336328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.336651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.336881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.337537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.339179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.340272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3321288-3995-418b-9b26-8d6db25c25c0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.346639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.347548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.347548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.347746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.348330 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.349919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.350623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1019/2038] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:38.358523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.365942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189b5fe-bbfc-4896-8d36-1072f51040b1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.366158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1020/2039] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:38.370753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.371379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.371657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.371887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.371981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.372632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.374268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.385997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1020/2040] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:38.391298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a68fd-09fb-4c05-874b-2b8e041aada0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.392173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.399108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.399508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.399990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.400462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.401638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.402617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4596f4-3c4a-428c-bc0e-fbd5c9b73607 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.404404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.408505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295bc69-fbd3-4a8d-bb17-90c9dbd17717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.409191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bc69-fbd3-4a8d-bb17-90c9dbd17717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.409474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bc69-fbd3-4a8d-bb17-90c9dbd17717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.409753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295bc69-fbd3-4a8d-bb17-90c9dbd17717 admin admin] PATH_INFO: `/v3/projects/ee80d35b07bd4664887bb46724027d3e/users/592928c476c54391b20d14a9370e3845/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.428047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1021/2041] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:38.434586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.446757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295bc69-fbd3-4a8d-bb17-90c9dbd17717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee80d35b07bd4664887bb46724027d3e, user_id=592928c476c54391b20d14a9370e3845, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.452551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbb222-29c4-48bb-b122-fbf1ecafd7fd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.453747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295bc69-fbd3-4a8d-bb17-90c9dbd17717 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.461889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53839379-309e-44d3-a76a-19f92b6c7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.463108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839379-309e-44d3-a76a-19f92b6c7d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.463616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839379-309e-44d3-a76a-19f92b6c7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.464168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53839379-309e-44d3-a76a-19f92b6c7d7f admin admin] PATH_INFO: `/v3/projects/d9d83636edbc4a9291f7146f3e2046da/users/468d4d30a6bb49fab06ce897cfa3b299/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.472997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1021/2042] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:38 2022] PUT /identity/v3/projects/ee80d35b07bd4664887bb46724027d3e/users/592928c476c54391b20d14a9370e3845/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:38.487490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53839379-309e-44d3-a76a-19f92b6c7d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d83636edbc4a9291f7146f3e2046da, user_id=468d4d30a6bb49fab06ce897cfa3b299, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.490181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53839379-309e-44d3-a76a-19f92b6c7d7f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.493377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeddf7-d91e-4d46-9564-3e2fa1a3a4f0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.493889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeddf7-d91e-4d46-9564-3e2fa1a3a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.494431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daeddf7-d91e-4d46-9564-3e2fa1a3a4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.508169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1022/2043] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:38 2022] PUT /identity/v3/projects/d9d83636edbc4a9291f7146f3e2046da/users/468d4d30a6bb49fab06ce897cfa3b299/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:38.526850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e29e-17ad-482b-b28c-5f51d09bc2d8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.527116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e29e-17ad-482b-b28c-5f51d09bc2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.527317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0e29e-17ad-482b-b28c-5f51d09bc2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.546585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5daeddf7-d91e-4d46-9564-3e2fa1a3a4f0 None None] MFA Rules not processed for user `592928c476c54391b20d14a9370e3845`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:38.548706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5daeddf7-d91e-4d46-9564-3e2fa1a3a4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:38.574154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6ee0e29e-17ad-482b-b28c-5f51d09bc2d8 None None] MFA Rules not processed for user `468d4d30a6bb49fab06ce897cfa3b299`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:38.575453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ee0e29e-17ad-482b-b28c-5f51d09bc2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:38.679817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1022/2044] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:38.684566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeddf7-d91e-4d46-9564-3e2fa1a3a4f0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.689606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1023/2045] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:38.690860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0e29e-17ad-482b-b28c-5f51d09bc2d8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.709321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:38.721606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:38.764751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0e29e-17ad-482b-b28c-5f51d09bc2d8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.770222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.770878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.771159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.771428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.772209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.774280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.787302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daeddf7-d91e-4d46-9564-3e2fa1a3a4f0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:38.795612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:38.796438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:38.796886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:38.797271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:38.798200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:38.800596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:38.810737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1024/2046] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:38.818632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.852360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1023/2047] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:38.864076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:38.987326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee0eea-01cf-45ca-b942-8f44a3ed08eb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.058078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d93da-db68-42eb-9331-ddc5ae8dc171 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.078272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.078272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.078272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.078272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.078741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.078741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.095235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.095870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.096140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.096415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.097071 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.099147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.108828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1024/2048] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:39.113053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.129999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa73e1b-a296-4e86-bb02-dbc399943e82 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.142643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.143274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.143551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.143818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.144538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.145896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1025/2049] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:38 2022] POST /identity/v3/users => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:39.146465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.148140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.159162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1025/2050] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:39.164115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.165376 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a71b8e-15e4-4163-a145-162047a57b6b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.171016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.182896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.183444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.183932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.185699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.186136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d3f96-c2d5-4f36-ba07-bc0305c81c31 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.189528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.194395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.195659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.196217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.196784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] PATH_INFO: `/v3/projects/4b87e19eb6584fc08f02680de14d465c/users/d302070f3b4541cea9ec1e805500fad1/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.209979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1026/2051] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:39.214724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.222373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b87e19eb6584fc08f02680de14d465c, user_id=d302070f3b4541cea9ec1e805500fad1, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.225191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.234918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bce2cf-142e-49c1-b22a-9150e53bff13 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.248276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1026/2052] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:39 2022] PUT /identity/v3/projects/4b87e19eb6584fc08f02680de14d465c/users/d302070f3b4541cea9ec1e805500fad1/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:39.251358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.288544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:39.343511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:39.352033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b93b1-4fb2-4f67-996a-1f0b6afcb14e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.359038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.359771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.360047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.360331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.361085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.363023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.364872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.366624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.367148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.367651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] PATH_INFO: `/v3/projects/ef84475b7ad743b28e85df42594cdaba/users/463f5ad3ed344ced803b7bbc7910cc60/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.380570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1027/2053] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:39.385142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.401332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef84475b7ad743b28e85df42594cdaba, user_id=463f5ad3ed344ced803b7bbc7910cc60, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.410345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.410554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4acf1-52b3-4a84-8522-2694f947e7dc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.414235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f3af9-2bad-4846-b704-d3e14be03bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.415160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3af9-2bad-4846-b704-d3e14be03bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.415537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3af9-2bad-4846-b704-d3e14be03bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.416008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3af9-2bad-4846-b704-d3e14be03bd8 admin admin] PATH_INFO: `/v3/projects/4b87e19eb6584fc08f02680de14d465c/users/d302070f3b4541cea9ec1e805500fad1/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.418540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f3af9-2bad-4846-b704-d3e14be03bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b87e19eb6584fc08f02680de14d465c, user_id=d302070f3b4541cea9ec1e805500fad1, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.422109 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f3af9-2bad-4846-b704-d3e14be03bd8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.425791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1027/2054] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:39 2022] PUT /identity/v3/projects/ef84475b7ad743b28e85df42594cdaba/users/463f5ad3ed344ced803b7bbc7910cc60/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:39.430575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.433968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1028/2055] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:39 2022] PUT /identity/v3/projects/4b87e19eb6584fc08f02680de14d465c/users/d302070f3b4541cea9ec1e805500fad1/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:39.445749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.446031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.446350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.485214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] MFA Rules not processed for user `d302070f3b4541cea9ec1e805500fad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:39.487256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:39.502774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66081b-c845-4cfa-bcf0-9e9ad20b95d6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.585628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.587228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.587680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.588102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.588954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.590834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.593854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1029/2056] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:39.605034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1028/2057] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:39.608950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.610420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:39.612068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.625654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9355bf1-d368-4fa8-8f40-47a9319ca1c4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.631118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b04be-202e-4ee5-af99-c8103d05ea76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.631905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b04be-202e-4ee5-af99-c8103d05ea76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.632264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b04be-202e-4ee5-af99-c8103d05ea76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.632617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b04be-202e-4ee5-af99-c8103d05ea76 admin admin] PATH_INFO: `/v3/projects/ef84475b7ad743b28e85df42594cdaba/users/463f5ad3ed344ced803b7bbc7910cc60/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.634976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b04be-202e-4ee5-af99-c8103d05ea76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef84475b7ad743b28e85df42594cdaba, user_id=463f5ad3ed344ced803b7bbc7910cc60, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.637858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b04be-202e-4ee5-af99-c8103d05ea76 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.651401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1029/2058] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:39 2022] PUT /identity/v3/projects/ef84475b7ad743b28e85df42594cdaba/users/463f5ad3ed344ced803b7bbc7910cc60/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:39.670500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5980c19-381e-45d9-9a98-daadd39c9f5c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.671001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5980c19-381e-45d9-9a98-daadd39c9f5c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.671499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5980c19-381e-45d9-9a98-daadd39c9f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.692927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764ecb3-c5e6-410b-b83a-1243841fbba0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.720632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a5980c19-381e-45d9-9a98-daadd39c9f5c None None] MFA Rules not processed for user `463f5ad3ed344ced803b7bbc7910cc60`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:39.722678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a5980c19-381e-45d9-9a98-daadd39c9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:39.747947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.748682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.748964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.749261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.787780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:39.798784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:39.824215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.826071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.840648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1030/2059] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:39.864953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1030/2060] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:39.884275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:39.887048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:39.912703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9068a-bf1e-4682-9b4a-fb4f7f85ecea service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:39.919846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda12d1-d432-4146-bbd3-488bf07c89a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:39.920978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda12d1-d432-4146-bbd3-488bf07c89a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:39.921264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda12d1-d432-4146-bbd3-488bf07c89a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:39.921567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda12d1-d432-4146-bbd3-488bf07c89a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:39.932293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda12d1-d432-4146-bbd3-488bf07c89a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:39.933755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda12d1-d432-4146-bbd3-488bf07c89a8 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:39.953148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1031/2061] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:40.262781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5980c19-381e-45d9-9a98-daadd39c9f5c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.376753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5980c19-381e-45d9-9a98-daadd39c9f5c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:40.385979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:40.386763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.387147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.387496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] PATH_INFO: `/v3/users/468d4d30a6bb49fab06ce897cfa3b299` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.389499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=468d4d30a6bb49fab06ce897cfa3b299)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:40.392283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:40.467484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468d4d30a6bb49fab06ce897cfa3b299'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.484463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468d4d30a6bb49fab06ce897cfa3b299'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.493906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468d4d30a6bb49fab06ce897cfa3b299'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.507226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468d4d30a6bb49fab06ce897cfa3b299'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.508015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468d4d30a6bb49fab06ce897cfa3b299'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:40.517349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1031/2062] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:40 2022] DELETE /identity/v3/users/468d4d30a6bb49fab06ce897cfa3b299 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:40.524843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.525678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.525678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.549625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:40.550919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.616840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1032/2063] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:40.628092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:40.629749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:40.695072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479693f-1b17-43f0-9202-39aaf70295ad admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:40.698909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:40.699540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:40.699821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:40.700092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:40.708654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:40.711406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:40.713736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:40.726141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1032/2064] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:41.063722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.065374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:41.082290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ff14b-21c4-46f2-9c3f-6049659abda4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.087436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.088103 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.088382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.088661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] PATH_INFO: `/v3/projects/d9d83636edbc4a9291f7146f3e2046da` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.089900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d83636edbc4a9291f7146f3e2046da)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.092304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.165656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d83636edbc4a9291f7146f3e2046da', 'request_id': 'req-a05030a3-72a5-4808-8105-b4bd6632f877'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.175735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d83636edbc4a9291f7146f3e2046da', 'request_id': 'req-a05030a3-72a5-4808-8105-b4bd6632f877'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.187054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d83636edbc4a9291f7146f3e2046da', 'request_id': 'req-a05030a3-72a5-4808-8105-b4bd6632f877'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.202016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] The token cache is being invalidate because project d9d83636edbc4a9291f7146f3e2046da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:41.202348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.203041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.207582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1033/2065] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:41 2022] DELETE /identity/v3/projects/d9d83636edbc4a9291f7146f3e2046da => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:41.209080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.220763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f86ba-02de-483e-9f1f-b4d1a88cd524 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.286638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:41.287517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:41.287837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:41.288112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] PATH_INFO: `/v3/users/463f5ad3ed344ced803b7bbc7910cc60` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:41.289308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=463f5ad3ed344ced803b7bbc7910cc60)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:41.291292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:41.391120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463f5ad3ed344ced803b7bbc7910cc60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.423286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463f5ad3ed344ced803b7bbc7910cc60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.439235 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463f5ad3ed344ced803b7bbc7910cc60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.457240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463f5ad3ed344ced803b7bbc7910cc60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.459196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463f5ad3ed344ced803b7bbc7910cc60'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:41.473968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1033/2066] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:41 2022] DELETE /identity/v3/users/463f5ad3ed344ced803b7bbc7910cc60 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:41.935298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.937220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:41.966466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:41.969618 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05030a3-72a5-4808-8105-b4bd6632f877 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:41.970815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.041712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:42.061158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b52aad-3dd3-4881-bbbc-15ec1b82c2f0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.066216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50dbd55-fea8-4fa5-b485-fa1e4d4a0502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.066885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dbd55-fea8-4fa5-b485-fa1e4d4a0502 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.067174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dbd55-fea8-4fa5-b485-fa1e4d4a0502 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.067463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50dbd55-fea8-4fa5-b485-fa1e4d4a0502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.070356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c50dbd55-fea8-4fa5-b485-fa1e4d4a0502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.078233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.079531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.080016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.080494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] PATH_INFO: `/v3/projects/ef84475b7ad743b28e85df42594cdaba` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.082848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef84475b7ad743b28e85df42594cdaba)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.086971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.109321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:42.159593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef84475b7ad743b28e85df42594cdaba', 'request_id': 'req-935d625a-ce7c-4ac1-816c-de8fb2523273'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.160197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dbd55-fea8-4fa5-b485-fa1e4d4a0502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.161750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50dbd55-fea8-4fa5-b485-fa1e4d4a0502 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.172999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef84475b7ad743b28e85df42594cdaba', 'request_id': 'req-935d625a-ce7c-4ac1-816c-de8fb2523273'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.177327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1034/2067] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:42.182196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef84475b7ad743b28e85df42594cdaba', 'request_id': 'req-935d625a-ce7c-4ac1-816c-de8fb2523273'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.196530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] The token cache is being invalidate because project ef84475b7ad743b28e85df42594cdaba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:42.196812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.197544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-935d625a-ce7c-4ac1-816c-de8fb2523273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:42.199126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1034/2068] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:41 2022] DELETE /identity/v3/projects/ef84475b7ad743b28e85df42594cdaba => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:42.205757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd46e9-19ba-4c6f-b8c9-24f0375807e3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.206216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd46e9-19ba-4c6f-b8c9-24f0375807e3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.206600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd46e9-19ba-4c6f-b8c9-24f0375807e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.231167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-74cd46e9-19ba-4c6f-b8c9-24f0375807e3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:42.232954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-74cd46e9-19ba-4c6f-b8c9-24f0375807e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.393822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1035/2069] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:42.405112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0c06-1174-465f-aa40-7ee06a29d0af None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.405991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0c06-1174-465f-aa40-7ee06a29d0af None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.406551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d0c06-1174-465f-aa40-7ee06a29d0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.444052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e26d0c06-1174-465f-aa40-7ee06a29d0af None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:42.446168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e26d0c06-1174-465f-aa40-7ee06a29d0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:42.472382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1035/2070] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:42.473537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd46e9-19ba-4c6f-b8c9-24f0375807e3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.494319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd46e9-19ba-4c6f-b8c9-24f0375807e3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.513687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.515044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.515593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.516246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.517656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:42.518319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.520814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.543958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1036/2071] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:42.545947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0c06-1174-465f-aa40-7ee06a29d0af None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.557891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d0c06-1174-465f-aa40-7ee06a29d0af None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.565181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.565814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.566093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.566908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.567645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.569878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.624035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1036/2072] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:42 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:42.632133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.648457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a083-9789-4a46-85a0-58431ad96e18 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.751382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.752536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.753341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.753623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.754344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.756321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.781395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1037/2073] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:42 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:42.786878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.800002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2572a05-011d-4c05-8f60-76aaeff6dda5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.806271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.806916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.807194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.807478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.808136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.809882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.823223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1037/2074] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:42.827349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.837994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e2c08-1cbc-4bd0-a0bb-e93578cd3402 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.848791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34604095-b92a-4edc-84f7-667a09dab81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.850047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604095-b92a-4edc-84f7-667a09dab81a admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.850456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604095-b92a-4edc-84f7-667a09dab81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.850902 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604095-b92a-4edc-84f7-667a09dab81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.851913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34604095-b92a-4edc-84f7-667a09dab81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.854574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34604095-b92a-4edc-84f7-667a09dab81a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.871633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1038/2075] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:42.875801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:42.890820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96703327-7d32-4a3d-86eb-43bf5ae7a3bc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:42.895874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:42.896538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.896819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.897099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] PATH_INFO: `/v3/projects/b87efca7b92440849b5f37d4c839ae48/users/f6f268ab25824d63b2c424244b9f8ac7/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:42.948091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87efca7b92440849b5f37d4c839ae48, user_id=f6f268ab25824d63b2c424244b9f8ac7, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:42.951309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:42.975601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1038/2076] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:42 2022] PUT /identity/v3/projects/b87efca7b92440849b5f37d4c839ae48/users/f6f268ab25824d63b2c424244b9f8ac7/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:42.984089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:42.984904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:42.984904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.020354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] MFA Rules not processed for user `f6f268ab25824d63b2c424244b9f8ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:43.021705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.064220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:43.104986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.108095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.126408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1039/2077] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:43.136306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.139179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.243413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a80b55-f69b-4bf5-9f6e-8318399a0b33 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.249931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa13ad-f687-4f2a-8fe4-8daf69ec3a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.251018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa13ad-f687-4f2a-8fe4-8daf69ec3a08 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.251499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa13ad-f687-4f2a-8fe4-8daf69ec3a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.251981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa13ad-f687-4f2a-8fe4-8daf69ec3a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.252387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a854-b41d-4626-b87b-9c699ebec88c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.255071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3aaa13ad-f687-4f2a-8fe4-8daf69ec3a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.258885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.260036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.260464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.260968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.277910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.281390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.295386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1040/2078] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:43.303936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:43.324302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.374505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa13ad-f687-4f2a-8fe4-8daf69ec3a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.377874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa13ad-f687-4f2a-8fe4-8daf69ec3a08 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.398172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1039/2079] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:43.453872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c13776-507b-4eaa-8b34-1a6f8f68af15 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.459603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.460272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.460568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.460851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] PATH_INFO: `/v3/users/f6f268ab25824d63b2c424244b9f8ac7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.462760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f268ab25824d63b2c424244b9f8ac7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.464798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.540228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f268ab25824d63b2c424244b9f8ac7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.569782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f268ab25824d63b2c424244b9f8ac7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.574759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:43.582088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f268ab25824d63b2c424244b9f8ac7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.600346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f268ab25824d63b2c424244b9f8ac7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.601472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f268ab25824d63b2c424244b9f8ac7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:43.609354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1041/2080] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:43 2022] DELETE /identity/v3/users/f6f268ab25824d63b2c424244b9f8ac7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:43.614185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.614604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.614905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.637437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:43.639318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.738349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1040/2081] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:43.754526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:43.756012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:43.875841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18cf45-3560-4b51-be2a-e917014ff14f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:43.882029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa981a7-1c2f-4b86-a5a8-611f82217e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:43.883131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa981a7-1c2f-4b86-a5a8-611f82217e83 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:43.883673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa981a7-1c2f-4b86-a5a8-611f82217e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:43.884171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa981a7-1c2f-4b86-a5a8-611f82217e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:43.901770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa981a7-1c2f-4b86-a5a8-611f82217e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:43.904263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa981a7-1c2f-4b86-a5a8-611f82217e83 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:43.921889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1042/2082] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:44.302036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.303993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:44.322108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e7425-e825-4ca2-92b4-b14ed9264c61 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.327903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.328591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.328869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.329143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] PATH_INFO: `/v3/projects/b87efca7b92440849b5f37d4c839ae48` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.330374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87efca7b92440849b5f37d4c839ae48)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.332396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.385973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87efca7b92440849b5f37d4c839ae48', 'request_id': 'req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:44.396379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87efca7b92440849b5f37d4c839ae48', 'request_id': 'req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:44.404809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87efca7b92440849b5f37d4c839ae48', 'request_id': 'req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:44.415856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] The token cache is being invalidate because project b87efca7b92440849b5f37d4c839ae48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:44.416144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:44.416808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9ed26ac-4d50-4dc4-ba41-20d01c7e76e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:44.418345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1041/2083] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:44 2022] DELETE /identity/v3/projects/b87efca7b92440849b5f37d4c839ae48 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:44.423989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92e35-5fd9-4600-843e-2786861b95fa None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.424542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92e35-5fd9-4600-843e-2786861b95fa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.424542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb92e35-5fd9-4600-843e-2786861b95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.445073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-beb92e35-5fd9-4600-843e-2786861b95fa None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:44.446468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-beb92e35-5fd9-4600-843e-2786861b95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:44.527955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1043/2084] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:44.536230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563556e-32c4-4695-93f6-1389e0606203 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.536529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563556e-32c4-4695-93f6-1389e0606203 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.536824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563556e-32c4-4695-93f6-1389e0606203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.560465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a563556e-32c4-4695-93f6-1389e0606203 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:44.561736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a563556e-32c4-4695-93f6-1389e0606203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:44.575017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1042/2085] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:44.576608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92e35-5fd9-4600-843e-2786861b95fa None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.587232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb92e35-5fd9-4600-843e-2786861b95fa None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.595841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.596430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.596627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.596877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.597545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:44.597845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.599534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.620929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1044/2086] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:16:44.627404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563556e-32c4-4695-93f6-1389e0606203 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.648381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563556e-32c4-4695-93f6-1389e0606203 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.657685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.659011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.659496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.659985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.661165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.664821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.713896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1043/2087] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:44.715160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.726533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860c70-3d09-44f5-acd6-e93d8c569cc4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.829534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.830453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.830818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.831230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.831991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.834767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.867255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1045/2088] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:44 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:44.872146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.886308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a29674-1a85-4ef3-8584-141030060ce0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.892962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.893704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.894162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.894587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.895374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:44.898148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:44.929559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1044/2089] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:44.930860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:44.966816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6acf-514b-451d-bc38-633acb58bec1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:44.975734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6511f-dd4b-413c-9d85-5e73e4bee990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:44.976975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6511f-dd4b-413c-9d85-5e73e4bee990 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:44.977430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6511f-dd4b-413c-9d85-5e73e4bee990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:44.977849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6511f-dd4b-413c-9d85-5e73e4bee990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:44.979010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6511f-dd4b-413c-9d85-5e73e4bee990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.031272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6511f-dd4b-413c-9d85-5e73e4bee990 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.038881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:45.066225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1046/2090] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:45.071748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.079939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:45.090520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de4059-43fe-4f86-b5a4-cca28a7e8821 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.098087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.099172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.099614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.100043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] PATH_INFO: `/v3/projects/92dd58735ff041228f7f6c2b0e566841/users/9a5b5bf973d544eba99bdcea6d4d6749/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.136834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92dd58735ff041228f7f6c2b0e566841, user_id=9a5b5bf973d544eba99bdcea6d4d6749, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.140383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.171097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1045/2091] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:45 2022] PUT /identity/v3/projects/92dd58735ff041228f7f6c2b0e566841/users/9a5b5bf973d544eba99bdcea6d4d6749/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:45.190095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187ccd-d149-44f2-b142-027fa72d6d96 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.190609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187ccd-d149-44f2-b142-027fa72d6d96 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.191166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d187ccd-d149-44f2-b142-027fa72d6d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.242957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3d187ccd-d149-44f2-b142-027fa72d6d96 None None] MFA Rules not processed for user `9a5b5bf973d544eba99bdcea6d4d6749`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:45.244471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3d187ccd-d149-44f2-b142-027fa72d6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:45.353744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1047/2092] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:45.363568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.432421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b60d70-eb6e-4276-b19c-6745b6e08d53 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.437997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.438802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.438931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.439324 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.439963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.441860 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.490860 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1046/2093] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:45 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:45.494966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d187ccd-d149-44f2-b142-027fa72d6d96 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.506300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d187ccd-d149-44f2-b142-027fa72d6d96 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.601879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.602677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.602966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.603238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.604103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.606748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.637270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1048/2094] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:45 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:45.642318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.654802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2d04c-d875-47db-a2b2-515e87586114 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.659858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.660538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.660814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.661088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.661773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.663575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.676468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1047/2095] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:45.681346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.691628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d851937-12eb-4f9b-9128-71c52a97043e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.696409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a6f05-3e2b-4468-b417-7856be0b7412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.697015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6f05-3e2b-4468-b417-7856be0b7412 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.697297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6f05-3e2b-4468-b417-7856be0b7412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.697849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6f05-3e2b-4468-b417-7856be0b7412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.698540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a6f05-3e2b-4468-b417-7856be0b7412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.700139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a6f05-3e2b-4468-b417-7856be0b7412 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.714845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1049/2096] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:45.719739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.730284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cecaae-a6d6-4779-94c0-9dc243296e41 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.736807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.737476 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.737755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.738028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] PATH_INFO: `/v3/projects/4fbf6cb291d64c979ee4769220567168/users/0f24400614204d92adf4c41795fa6a90/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.757408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fbf6cb291d64c979ee4769220567168, user_id=0f24400614204d92adf4c41795fa6a90, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.760127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:45.777890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1048/2097] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:45 2022] PUT /identity/v3/projects/4fbf6cb291d64c979ee4769220567168/users/0f24400614204d92adf4c41795fa6a90/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:45.789372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ea25-dab8-40ce-9346-a7c281330485 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.789700 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ea25-dab8-40ce-9346-a7c281330485 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.789991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ea25-dab8-40ce-9346-a7c281330485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.821729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4cc5ea25-dab8-40ce-9346-a7c281330485 None None] MFA Rules not processed for user `0f24400614204d92adf4c41795fa6a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:45.822996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4cc5ea25-dab8-40ce-9346-a7c281330485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:45.884430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:45.896451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1050/2098] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:45.901312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:45.969603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21229-d840-42e7-a869-e73495ffc631 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:45.975296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:45.975928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:45.976215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:45.976489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:45.977151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:45.979131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:46.010208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1049/2099] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:45 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:46.014439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ea25-dab8-40ce-9346-a7c281330485 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:46.026163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ea25-dab8-40ce-9346-a7c281330485 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:46.094811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:46.095610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:46.095988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:46.096354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:46.097134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:46.099393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:46.126350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1051/2100] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:46 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:46.130449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:46.141613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c0aa-d313-4a2c-a681-1f0af48c3305 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:46.148570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:46.149895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:46.150438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:46.150927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:46.152110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:46.156133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:46.201354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1050/2101] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:46.202789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:46.217032 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21934cdc-175f-4a49-8942-3417d36ef8c2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:46.227675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:46.228566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:46.229009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:46.229464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] PATH_INFO: `/v3/projects/ac81c6e23da2484d8536e93e84de1e47/users/adc0d6dcd9264943bb0d04c24e9261d1/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:46.248417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac81c6e23da2484d8536e93e84de1e47, user_id=adc0d6dcd9264943bb0d04c24e9261d1, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:46.251712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:46.270289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1052/2102] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:46 2022] PUT /identity/v3/projects/ac81c6e23da2484d8536e93e84de1e47/users/adc0d6dcd9264943bb0d04c24e9261d1/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:46.274960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:46.288755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:46.298361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44240a8-6944-4223-82b0-f83823329400 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:46.407241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab5dc8-fa42-40ad-8b1d-8e90a995c7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:46.408690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5dc8-fa42-40ad-8b1d-8e90a995c7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:46.409401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5dc8-fa42-40ad-8b1d-8e90a995c7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:46.409843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab5dc8-fa42-40ad-8b1d-8e90a995c7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:46.410719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab5dc8-fa42-40ad-8b1d-8e90a995c7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:46.412878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab5dc8-fa42-40ad-8b1d-8e90a995c7a1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:46.440250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1051/2103] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:46.450155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:46.460994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b187-4bd7-4cac-bbae-4c2e1e3180cd admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:46.468648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:46.469292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:46.469667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:46.470018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] PATH_INFO: `/v3/projects/ac81c6e23da2484d8536e93e84de1e47/users/adc0d6dcd9264943bb0d04c24e9261d1/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:46.472598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac81c6e23da2484d8536e93e84de1e47, user_id=adc0d6dcd9264943bb0d04c24e9261d1, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:46.476299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:46.494339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1053/2104] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:46 2022] PUT /identity/v3/projects/ac81c6e23da2484d8536e93e84de1e47/users/adc0d6dcd9264943bb0d04c24e9261d1/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:46.504683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:46.505181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:46.505890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:46.549979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] MFA Rules not processed for user `adc0d6dcd9264943bb0d04c24e9261d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:46.551642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:46.674848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1052/2105] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:46.691667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:46.693497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:46.768966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498739-9c49-425f-aca5-a4d536ab6410 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:46.772761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b091dd3-e33a-47b2-9f5f-519da082db52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:46.773383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b091dd3-e33a-47b2-9f5f-519da082db52 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:46.773665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b091dd3-e33a-47b2-9f5f-519da082db52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:46.773938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b091dd3-e33a-47b2-9f5f-519da082db52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:46.848800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b091dd3-e33a-47b2-9f5f-519da082db52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:46.851447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b091dd3-e33a-47b2-9f5f-519da082db52 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:46.858830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:46.871477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1054/2106] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:47.855505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:47.857987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:47.936946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6d471-3107-4816-8e40-5814540937e3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:47.941975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:47.942686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:47.942996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:47.943269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] PATH_INFO: `/v3/users/67a55c97f13e4d2f86f009d1a135f7e8` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:47.944444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a55c97f13e4d2f86f009d1a135f7e8)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:47.946504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:47.994221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:48.021395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a55c97f13e4d2f86f009d1a135f7e8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.036316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a55c97f13e4d2f86f009d1a135f7e8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.045334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a55c97f13e4d2f86f009d1a135f7e8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.045849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a55c97f13e4d2f86f009d1a135f7e8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.054831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a55c97f13e4d2f86f009d1a135f7e8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.061873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1053/2107] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:47 2022] DELETE /identity/v3/users/67a55c97f13e4d2f86f009d1a135f7e8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:48.066657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:48.067336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:48.067336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:48.088066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:48.089392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:48.154346 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1055/2108] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:48.164549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:48.165969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:48.241029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498210b-af48-4c04-a0cc-002eebfd026c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:48.248877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:48.249976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:48.250555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:48.251325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:48.269531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:48.272369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:48.290627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1054/2109] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:48.544413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:48.545837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:48.675069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85cb5-ab07-4fe0-9ecb-43d187352665 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:48.680392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:48.681183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:48.681469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:48.681743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:48.684109 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:48.758985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:48.760709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:48.773105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:48.774626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1056/2110] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:48.776979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:48.794275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68c11-e007-4e9d-8841-d1fbb2bd32e8 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:48.800527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:48.801233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:48.801586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:48.801928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] PATH_INFO: `/v3/projects/64dd4ee3294f437fb414eec4ba93725d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:48.804165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64dd4ee3294f437fb414eec4ba93725d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:48.809142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:48.902575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64dd4ee3294f437fb414eec4ba93725d', 'request_id': 'req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.913315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64dd4ee3294f437fb414eec4ba93725d', 'request_id': 'req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.924029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64dd4ee3294f437fb414eec4ba93725d', 'request_id': 'req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.947782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] The token cache is being invalidate because project 64dd4ee3294f437fb414eec4ba93725d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:48.952067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.952067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:48.952640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1055/2111] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:48 2022] DELETE /identity/v3/projects/64dd4ee3294f437fb414eec4ba93725d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:48.957681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:48.995673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a1abb-af0a-4f2e-b668-10d2a012bf3b service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:49.096507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:49.105394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:49.106633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:49.106862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:49.107207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] PATH_INFO: `/v3/users/592928c476c54391b20d14a9370e3845` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:49.108482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592928c476c54391b20d14a9370e3845)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:49.110544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:49.192417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592928c476c54391b20d14a9370e3845'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.224731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592928c476c54391b20d14a9370e3845'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.239232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592928c476c54391b20d14a9370e3845'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.251335 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592928c476c54391b20d14a9370e3845'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.252293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592928c476c54391b20d14a9370e3845'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.260796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1057/2112] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:48 2022] DELETE /identity/v3/users/592928c476c54391b20d14a9370e3845 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:49.648926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:49.650497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:49.747275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:49.750202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:49.752821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:49.786661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fade5e4-14b9-4663-9a0a-6e6872ae71c9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:49.853365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8b84f-efa2-4706-a430-8f4d15617a80 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:49.863286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:49.864126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:49.864508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:49.864888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] PATH_INFO: `/v3/projects/ee80d35b07bd4664887bb46724027d3e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:49.866771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee80d35b07bd4664887bb46724027d3e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:49.869063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:49.910419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:49.911520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:49.912283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:49.912781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:49.918834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:49.943586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee80d35b07bd4664887bb46724027d3e', 'request_id': 'req-619b7fdc-72f0-4304-83ef-3c06a8d2c446'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.959166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee80d35b07bd4664887bb46724027d3e', 'request_id': 'req-619b7fdc-72f0-4304-83ef-3c06a8d2c446'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.967683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee80d35b07bd4664887bb46724027d3e', 'request_id': 'req-619b7fdc-72f0-4304-83ef-3c06a8d2c446'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.981072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] The token cache is being invalidate because project ee80d35b07bd4664887bb46724027d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:49.981713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.982424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:49.984608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1058/2113] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:49 2022] DELETE /identity/v3/projects/ee80d35b07bd4664887bb46724027d3e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:49.989084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:49.991184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:50.002535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:50.047621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:50.049218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:50.062070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1056/2114] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:50.107668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b7fdc-72f0-4304-83ef-3c06a8d2c446 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:50.116338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:50.116338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:50.116338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:50.116338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] PATH_INFO: `/v3/users/d302070f3b4541cea9ec1e805500fad1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:50.119697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d302070f3b4541cea9ec1e805500fad1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:50.124241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:50.226057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd302070f3b4541cea9ec1e805500fad1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.264706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd302070f3b4541cea9ec1e805500fad1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.279809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd302070f3b4541cea9ec1e805500fad1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.303513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd302070f3b4541cea9ec1e805500fad1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.305056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd302070f3b4541cea9ec1e805500fad1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.319261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1059/2115] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:49 2022] DELETE /identity/v3/users/d302070f3b4541cea9ec1e805500fad1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:50.689135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:50.707050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0b106-dc92-4eb8-95cc-e10f2cac228c service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:50.805789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:50.806633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:50.806977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:50.807288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] PATH_INFO: `/v3/projects/4b87e19eb6584fc08f02680de14d465c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:50.808615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b87e19eb6584fc08f02680de14d465c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:50.811030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:50.871633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:50.884853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b87e19eb6584fc08f02680de14d465c', 'request_id': 'req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.895731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b87e19eb6584fc08f02680de14d465c', 'request_id': 'req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.910268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b87e19eb6584fc08f02680de14d465c', 'request_id': 'req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.927860 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] The token cache is being invalidate because project 4b87e19eb6584fc08f02680de14d465c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:50.928509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.929089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cb8dc2bc-e0fc-4c7e-b61a-4d308205d21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:50.930979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1057/2116] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:50 2022] DELETE /identity/v3/projects/4b87e19eb6584fc08f02680de14d465c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:54.348768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.350257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.373253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45693-db20-4781-8726-359d84ef0725 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.461413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.462089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.462414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.462698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] PATH_INFO: `/v3/users/9a5b5bf973d544eba99bdcea6d4d6749` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.464064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a5b5bf973d544eba99bdcea6d4d6749)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.466193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.503098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:54.533388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a5b5bf973d544eba99bdcea6d4d6749'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.552228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a5b5bf973d544eba99bdcea6d4d6749'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.564420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a5b5bf973d544eba99bdcea6d4d6749'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.572992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a5b5bf973d544eba99bdcea6d4d6749'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.573786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a5b5bf973d544eba99bdcea6d4d6749'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:54.583593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1060/2117] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:54 2022] DELETE /identity/v3/users/9a5b5bf973d544eba99bdcea6d4d6749 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:54.588818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.589396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.589396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.610890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:54.612146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.699382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1058/2118] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:54.710084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:54.711751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:54.792944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c844b-1226-4d54-9a1d-6b6a6f37e1dc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:54.799999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:54.801073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:54.801642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:54.802146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:54.819740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:54.822769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:54.839260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1061/2119] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:16:55.219007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.220528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:55.235541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2500f-994b-4308-88c8-ebcfdff611c1 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.240251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.240901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.241244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.241519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] PATH_INFO: `/v3/projects/92dd58735ff041228f7f6c2b0e566841` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.242878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92dd58735ff041228f7f6c2b0e566841)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.244819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.304243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92dd58735ff041228f7f6c2b0e566841', 'request_id': 'req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.315727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92dd58735ff041228f7f6c2b0e566841', 'request_id': 'req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.324660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92dd58735ff041228f7f6c2b0e566841', 'request_id': 'req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.340182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] The token cache is being invalidate because project 92dd58735ff041228f7f6c2b0e566841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:55.340674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.343008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.345625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1059/2120] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:55 2022] DELETE /identity/v3/projects/92dd58735ff041228f7f6c2b0e566841 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:55.351979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:55.370165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435765f-f11b-42d6-8e19-fc368c873675 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:55.453876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:55.455301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:55.455742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:55.456093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] PATH_INFO: `/v3/users/0f24400614204d92adf4c41795fa6a90` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:55.458610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f24400614204d92adf4c41795fa6a90)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:55.462969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:55.554299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f24400614204d92adf4c41795fa6a90'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.555804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:55.581412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f24400614204d92adf4c41795fa6a90'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.604054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f24400614204d92adf4c41795fa6a90'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.622989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f24400614204d92adf4c41795fa6a90'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.625439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f24400614204d92adf4c41795fa6a90'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:55.649246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1062/2121] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:55 2022] DELETE /identity/v3/users/0f24400614204d92adf4c41795fa6a90 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:56.139830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.141526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:56.163055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6cecd-089e-4a89-9331-8fdfa2c2879f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.253122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:56.272142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.273233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.273732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.274225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] PATH_INFO: `/v3/projects/4fbf6cb291d64c979ee4769220567168` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.275635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fbf6cb291d64c979ee4769220567168)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.279331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.337179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fbf6cb291d64c979ee4769220567168', 'request_id': 'req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.346230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fbf6cb291d64c979ee4769220567168', 'request_id': 'req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.354062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fbf6cb291d64c979ee4769220567168', 'request_id': 'req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.372676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] The token cache is being invalidate because project 4fbf6cb291d64c979ee4769220567168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:56.373164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.374260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.376802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1060/2122] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:56 2022] DELETE /identity/v3/projects/4fbf6cb291d64c979ee4769220567168 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:16:56.382669 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.384388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:56.398973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f808-ce66-4a60-b6f3-e57490a92c8d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:56.467980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:56.468630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:56.468906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:56.469180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] PATH_INFO: `/v3/users/adc0d6dcd9264943bb0d04c24e9261d1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:56.470600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc0d6dcd9264943bb0d04c24e9261d1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:56.472852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:56.530144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc0d6dcd9264943bb0d04c24e9261d1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.544521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc0d6dcd9264943bb0d04c24e9261d1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.552258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc0d6dcd9264943bb0d04c24e9261d1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.560074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc0d6dcd9264943bb0d04c24e9261d1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.561252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc0d6dcd9264943bb0d04c24e9261d1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:56.568951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1063/2123] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:56 2022] DELETE /identity/v3/users/adc0d6dcd9264943bb0d04c24e9261d1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:56.976517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:56.979315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.001811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.005679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.012518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230ba50-e3d9-4d72-a1f5-7d3928cc8b30 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.086127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:57.107095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.107772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.109378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.109807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] PATH_INFO: `/v3/projects/ac81c6e23da2484d8536e93e84de1e47` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.111190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac81c6e23da2484d8536e93e84de1e47)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.112126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1597b76-17ed-4dea-b185-3393bc01c866 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.113138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.118721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.119181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.119464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.119822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] PATH_INFO: `/v3/users/c48a200229df4819934f6e3c12df38a1` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.121181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c48a200229df4819934f6e3c12df38a1)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.125255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.206409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac81c6e23da2484d8536e93e84de1e47', 'request_id': 'req-68031bd4-9fef-419c-869b-8b12c5eadd2d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.212495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48a200229df4819934f6e3c12df38a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.218344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac81c6e23da2484d8536e93e84de1e47', 'request_id': 'req-68031bd4-9fef-419c-869b-8b12c5eadd2d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.227527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac81c6e23da2484d8536e93e84de1e47', 'request_id': 'req-68031bd4-9fef-419c-869b-8b12c5eadd2d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.238512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48a200229df4819934f6e3c12df38a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.251308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] The token cache is being invalidate because project ac81c6e23da2484d8536e93e84de1e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:57.251773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.252940 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-68031bd4-9fef-419c-869b-8b12c5eadd2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.254136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48a200229df4819934f6e3c12df38a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.260882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1061/2124] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:56 2022] DELETE /identity/v3/projects/ac81c6e23da2484d8536e93e84de1e47 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:57.265107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ed054-5b8b-43b3-95f2-d89aee20b345 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.265611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ed054-5b8b-43b3-95f2-d89aee20b345 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.266021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ed054-5b8b-43b3-95f2-d89aee20b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.276023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48a200229df4819934f6e3c12df38a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.277151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d233bcb2-ef76-454a-b231-1e9f91fdfdb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48a200229df4819934f6e3c12df38a1'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:57.290272 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1064/2125] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:16:57 2022] DELETE /identity/v3/users/c48a200229df4819934f6e3c12df38a1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:57.298536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.299114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.299701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.313770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-078ed054-5b8b-43b3-95f2-d89aee20b345 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:57.315363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-078ed054-5b8b-43b3-95f2-d89aee20b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.334702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:57.352236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:57.354288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.405350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1062/2126] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:57.413843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaa0a4-84ea-4413-8eec-352d197fb7cc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.414338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaa0a4-84ea-4413-8eec-352d197fb7cc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.414694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcaa0a4-84ea-4413-8eec-352d197fb7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.443512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-abcaa0a4-84ea-4413-8eec-352d197fb7cc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:57.445376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-abcaa0a4-84ea-4413-8eec-352d197fb7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.458267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1063/2127] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:57.463090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaa0a4-84ea-4413-8eec-352d197fb7cc None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.468760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1065/2128] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:57.476983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcaa0a4-84ea-4413-8eec-352d197fb7cc None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.479044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.481205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:57.486019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.487026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.487474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.487914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.489009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:57.489494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.492484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.520028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1064/2129] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:57.525697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.539743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746622f6-fc5c-48dc-8d82-4be897acee41 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.546174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.546834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.547111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.547385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.548035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.549999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.570334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8deb42-c8d8-43aa-a974-bf6f1d19da85 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.574634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.575516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.575899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.576171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.587450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.588991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.597343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1065/2130] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:57.603850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.608531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1066/2131] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:57.683045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ac455-38bc-42d0-a69b-f917ee0c1b61 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.689265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.689936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.690183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.690493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.691199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.693196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.723700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1066/2132] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:57.725737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.744163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f76b2c-3b1a-4371-af77-dd5e32bdd163 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.752831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.753851 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.754468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.754958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.756144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.759244 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.761519 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:57.775590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1067/2133] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:57.780876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.800548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4b30e-12d4-41cd-acdb-ed8be87d5936 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.806288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d3752-3b30-4899-a5d4-e80a22c71529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.807778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d3752-3b30-4899-a5d4-e80a22c71529 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.807778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d3752-3b30-4899-a5d4-e80a22c71529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.807778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d3752-3b30-4899-a5d4-e80a22c71529 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.809382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d3752-3b30-4899-a5d4-e80a22c71529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.810394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d3752-3b30-4899-a5d4-e80a22c71529 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.839759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1067/2134] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:57.843078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:57.856074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec5750-bacc-4a0f-96ca-6eefff0fb35f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:57.866509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:57.867509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.867798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.868185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] PATH_INFO: `/v3/projects/4928f81291a349929227fa4392975809/users/2e294205ca7545efa83d8a6f86c669e8/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.892566 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4928f81291a349929227fa4392975809, user_id=2e294205ca7545efa83d8a6f86c669e8, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:57.895397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:57.913762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1068/2135] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:57 2022] PUT /identity/v3/projects/4928f81291a349929227fa4392975809/users/2e294205ca7545efa83d8a6f86c669e8/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:57.924032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:57.924483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:57.924829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:57.973711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] MFA Rules not processed for user `2e294205ca7545efa83d8a6f86c669e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:57.975094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.030890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.089809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1068/2136] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:58.103896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.105070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.106154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.107095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.190118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21fc60-5eed-4407-bcb4-70e9bdfdef5c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.194161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f973a0-f850-4779-aaae-64b551ef2361 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.194986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f973a0-f850-4779-aaae-64b551ef2361 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.195275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f973a0-f850-4779-aaae-64b551ef2361 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.195546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f973a0-f850-4779-aaae-64b551ef2361 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.206158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f973a0-f850-4779-aaae-64b551ef2361 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.207790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f973a0-f850-4779-aaae-64b551ef2361 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.208756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44780807-d6f0-4f19-ba1f-ae882df842d5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.214047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.214737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.215023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.215302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] PATH_INFO: `/v3/projects/63d7ba3b8db34bb5bf2c7df3889d4bce` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.216913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d7ba3b8db34bb5bf2c7df3889d4bce)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.218889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.226840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1069/2137] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:16:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:16:58.287674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d7ba3b8db34bb5bf2c7df3889d4bce', 'request_id': 'req-539c5a8f-0041-4946-8799-069ca36969ca'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:58.298824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d7ba3b8db34bb5bf2c7df3889d4bce', 'request_id': 'req-539c5a8f-0041-4946-8799-069ca36969ca'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:58.311919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d7ba3b8db34bb5bf2c7df3889d4bce', 'request_id': 'req-539c5a8f-0041-4946-8799-069ca36969ca'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:58.329290 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] The token cache is being invalidate because project 63d7ba3b8db34bb5bf2c7df3889d4bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:16:58.329664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:58.330470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-539c5a8f-0041-4946-8799-069ca36969ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:16:58.332023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1069/2138] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:16:58 2022] DELETE /identity/v3/projects/63d7ba3b8db34bb5bf2c7df3889d4bce => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:58.336875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d34d6-f968-4231-b148-abcdc6bc4313 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.337160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d34d6-f968-4231-b148-abcdc6bc4313 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.337434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d34d6-f968-4231-b148-abcdc6bc4313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.368054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-002d34d6-f968-4231-b148-abcdc6bc4313 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:58.369553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-002d34d6-f968-4231-b148-abcdc6bc4313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.499879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1070/2139] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:58.508029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94b7d1-2ce8-49bd-9e43-950f1de961d0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.508676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94b7d1-2ce8-49bd-9e43-950f1de961d0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.508676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94b7d1-2ce8-49bd-9e43-950f1de961d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.531245 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7e94b7d1-2ce8-49bd-9e43-950f1de961d0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:58.532502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7e94b7d1-2ce8-49bd-9e43-950f1de961d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:58.541240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1070/2140] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:58.546463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d34d6-f968-4231-b148-abcdc6bc4313 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.556514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d34d6-f968-4231-b148-abcdc6bc4313 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.561560 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.562393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.562756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.563110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.563971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:16:58.564326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.566397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.585863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1071/2141] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:16:58.587031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94b7d1-2ce8-49bd-9e43-950f1de961d0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.601708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94b7d1-2ce8-49bd-9e43-950f1de961d0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.607709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.608393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.608747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.609105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.609830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.611872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.646231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1071/2142] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:16:58.650656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.661762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393095-2335-40a5-acba-7366da8c76ae admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.741216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.741908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.742366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.742650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.743505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.745649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.768024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.787232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1072/2143] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:58.788440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.802003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ac56c-32ac-4f88-bd69-64560e40d545 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.807575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.808328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.808608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.808882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.809613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.811749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.835230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1072/2144] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:16:58.841792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.860881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdadcb9-4b99-48d5-9164-517833414e18 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.870612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb624f5-0770-4557-bcd9-d4011aaa44cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.871541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb624f5-0770-4557-bcd9-d4011aaa44cd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.872016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb624f5-0770-4557-bcd9-d4011aaa44cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.872408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb624f5-0770-4557-bcd9-d4011aaa44cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.873729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb624f5-0770-4557-bcd9-d4011aaa44cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.876060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb624f5-0770-4557-bcd9-d4011aaa44cd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.891087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1073/2145] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:58.895843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:58.908983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861999a2-07a7-4377-8021-7112069f7a2f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:58.914512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:58.915270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.915604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.916017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] PATH_INFO: `/v3/projects/09ec9657f93b4df4a94366ffe7a1bfcf/users/be9b1415b3b84a65af2885c01d144f65/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:58.944418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ec9657f93b4df4a94366ffe7a1bfcf, user_id=be9b1415b3b84a65af2885c01d144f65, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:58.949886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:58.965371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:58.980778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1073/2146] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:58 2022] PUT /identity/v3/projects/09ec9657f93b4df4a94366ffe7a1bfcf/users/be9b1415b3b84a65af2885c01d144f65/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:58.992268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956c954-7c2d-4f41-93f3-dd1d0354db98 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:58.992685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956c954-7c2d-4f41-93f3-dd1d0354db98 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:58.993029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956c954-7c2d-4f41-93f3-dd1d0354db98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.027732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3956c954-7c2d-4f41-93f3-dd1d0354db98 None None] MFA Rules not processed for user `be9b1415b3b84a65af2885c01d144f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:59.029278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3956c954-7c2d-4f41-93f3-dd1d0354db98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:59.111312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1074/2147] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:16:59.115954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.218456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab6aa9-39d4-4a51-aec7-c0f15c16dca7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.226697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.227770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.228262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.228743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.229948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.233795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.272821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1074/2148] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:59 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:59.277401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956c954-7c2d-4f41-93f3-dd1d0354db98 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.290133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956c954-7c2d-4f41-93f3-dd1d0354db98 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.367294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.367797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.368076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.368349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.368998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.371023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.395107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1075/2149] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:59 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:59.399237 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.410939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a1dfa-531c-4ce1-b58e-71d621810a36 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.415908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.416535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.416818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.417092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.417760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.420198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.431892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1075/2150] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:59.437209 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.449748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56ec4-b4f5-4fc3-a657-1d898b1dd380 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.455744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae2be4-f315-4647-8d9f-9cbc6e64a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.456542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae2be4-f315-4647-8d9f-9cbc6e64a200 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.456947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae2be4-f315-4647-8d9f-9cbc6e64a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.457315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae2be4-f315-4647-8d9f-9cbc6e64a200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.458028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae2be4-f315-4647-8d9f-9cbc6e64a200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.459874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae2be4-f315-4647-8d9f-9cbc6e64a200 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.472472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1076/2151] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:16:59.477205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.489317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3201ec5-cca6-4d69-ac92-89fcfd374851 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.494415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.495395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.495677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.495958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] PATH_INFO: `/v3/projects/95ad6bc3d379414c9c65c9bc622a7e31/users/d3ec6fd8a1304181a2cf07a6e8d6e30b/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.515900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ad6bc3d379414c9c65c9bc622a7e31, user_id=d3ec6fd8a1304181a2cf07a6e8d6e30b, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.518423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.540347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1076/2152] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:16:59 2022] PUT /identity/v3/projects/95ad6bc3d379414c9c65c9bc622a7e31/users/d3ec6fd8a1304181a2cf07a6e8d6e30b/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:16:59.559678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee36c-1560-4ebc-b64e-65c51d8908e8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.560174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee36c-1560-4ebc-b64e-65c51d8908e8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.560672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee36c-1560-4ebc-b64e-65c51d8908e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.614771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-691ee36c-1560-4ebc-b64e-65c51d8908e8 None None] MFA Rules not processed for user `d3ec6fd8a1304181a2cf07a6e8d6e30b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:16:59.616038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-691ee36c-1560-4ebc-b64e-65c51d8908e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:16:59.701740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:16:59.728735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1077/2153] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:16:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:16:59.734073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.844868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aed607-855e-422d-b93e-89bb6c4982d6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.850791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.851426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.851706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.851979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:16:59.852637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:16:59.854670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:16:59.892220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1077/2154] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:16:59 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:16:59.897814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee36c-1560-4ebc-b64e-65c51d8908e8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:16:59.911898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee36c-1560-4ebc-b64e-65c51d8908e8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:16:59.997505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:16:59.998597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:16:59.998973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:16:59.999349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.000158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.002857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:00.043946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1078/2155] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:16:59 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:00.051003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:00.071572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1f3fe-c168-4a06-a448-f8a758432510 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:00.078507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:00.079184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.079439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.079716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.080391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.082159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:00.095788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1078/2156] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:00.099893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:00.114851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00017329-c145-46d7-8497-d8b3833ce73c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:00.120826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:00.121800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.123085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.123347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] PATH_INFO: `/v3/projects/8f4b9d67577440b68a4dd0999269cdbf/users/809d7aedd24441cda513ae238a63c8cb/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.144196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4b9d67577440b68a4dd0999269cdbf, user_id=809d7aedd24441cda513ae238a63c8cb, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.147853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:00.190130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1079/2157] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:00 2022] PUT /identity/v3/projects/8f4b9d67577440b68a4dd0999269cdbf/users/809d7aedd24441cda513ae238a63c8cb/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:00.194830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:00.224618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34d005-dd26-4bc4-9ccd-a8d0c04f93d6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:00.258612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:00.309128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3a09c-2f01-4087-8080-6fc06fc0e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:00.310535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a09c-2f01-4087-8080-6fc06fc0e7eb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.311083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a09c-2f01-4087-8080-6fc06fc0e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.311488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a09c-2f01-4087-8080-6fc06fc0e7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.312477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a09c-2f01-4087-8080-6fc06fc0e7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.314424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3a09c-2f01-4087-8080-6fc06fc0e7eb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:00.338012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1079/2158] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:00.343410 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:00.366035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665b12-9af9-45e6-916d-35821ce16ca7 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:00.373415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:00.374437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.374880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.375295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] PATH_INFO: `/v3/projects/8f4b9d67577440b68a4dd0999269cdbf/users/809d7aedd24441cda513ae238a63c8cb/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.378096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4b9d67577440b68a4dd0999269cdbf, user_id=809d7aedd24441cda513ae238a63c8cb, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.381279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:00.397015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1080/2159] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:00 2022] PUT /identity/v3/projects/8f4b9d67577440b68a4dd0999269cdbf/users/809d7aedd24441cda513ae238a63c8cb/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:00.415268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.415521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.415768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.460980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] MFA Rules not processed for user `809d7aedd24441cda513ae238a63c8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:00.462724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:00.571375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1080/2160] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:00.589097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:00.591730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:00.661151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc865de-da30-4e77-a3fc-ca37da7f3b4a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:00.665015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:00.665633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:00.665910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:00.666186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:00.761076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:00.781392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:00.783903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:00.795125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1081/2161] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:02.384314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:02.385789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:02.403880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb370-e1fa-4e99-b20e-e3fb7cb4db8e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:02.409996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:02.410710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:02.411215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:02.411718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:02.508023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:02.511764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:02.537909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1081/2162] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:03.296962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.306342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55f5b1-8fa7-4700-9b1d-e662cbb593ca service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.311692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e071a6d-9e84-449f-9f5c-8665476374b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.312327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071a6d-9e84-449f-9f5c-8665476374b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.312607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071a6d-9e84-449f-9f5c-8665476374b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.312898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e071a6d-9e84-449f-9f5c-8665476374b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.323462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e071a6d-9e84-449f-9f5c-8665476374b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.324935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e071a6d-9e84-449f-9f5c-8665476374b0 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.337936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1082/2163] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:03.727009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:03.729223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:03.808135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:03.834978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1608c-7846-4a5c-a6e6-feabc75da072 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:03.843352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:03.844501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.845022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.845535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] PATH_INFO: `/v3/users/2e294205ca7545efa83d8a6f86c669e8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.847879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e294205ca7545efa83d8a6f86c669e8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:03.851888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:03.913868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e294205ca7545efa83d8a6f86c669e8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.931541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e294205ca7545efa83d8a6f86c669e8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.944038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e294205ca7545efa83d8a6f86c669e8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.952750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e294205ca7545efa83d8a6f86c669e8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.953649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e294205ca7545efa83d8a6f86c669e8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:03.960431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1082/2164] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:03 2022] DELETE /identity/v3/users/2e294205ca7545efa83d8a6f86c669e8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:03.967014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:03.967360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:03.967636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:03.989697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:03.991072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:04.064580 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1083/2165] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:04.074791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.076455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:04.144998 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a03e8-fc7d-43e4-ade3-b46b8fa16b8a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.148828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.149450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.149733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.150010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.163250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.163250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.186817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1083/2166] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:04.597203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:04.599374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:04.626174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf960dba-12b8-4898-bdd0-35cd81427ef3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:04.632677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:04.633582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:04.634085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:04.634534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] PATH_INFO: `/v3/projects/4928f81291a349929227fa4392975809` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:04.636068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4928f81291a349929227fa4392975809)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:04.639676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:04.734414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4928f81291a349929227fa4392975809', 'request_id': 'req-90e9e0c5-6eef-4d55-b424-4005883dc86d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:04.744674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4928f81291a349929227fa4392975809', 'request_id': 'req-90e9e0c5-6eef-4d55-b424-4005883dc86d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:04.754352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4928f81291a349929227fa4392975809', 'request_id': 'req-90e9e0c5-6eef-4d55-b424-4005883dc86d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:04.772587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] The token cache is being invalidate because project 4928f81291a349929227fa4392975809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:04.772945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:04.773796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-90e9e0c5-6eef-4d55-b424-4005883dc86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:04.775801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1084/2167] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:04 2022] DELETE /identity/v3/projects/4928f81291a349929227fa4392975809 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:07.480612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.483166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.496562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6154e-2abc-4437-8ba0-2bf22a18fdb1 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.576254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.576903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.577184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.577487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] PATH_INFO: `/v3/users/be9b1415b3b84a65af2885c01d144f65` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.578795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9b1415b3b84a65af2885c01d144f65)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.580782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.586560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:07.665704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9b1415b3b84a65af2885c01d144f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.681926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9b1415b3b84a65af2885c01d144f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.695120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9b1415b3b84a65af2885c01d144f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.705709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9b1415b3b84a65af2885c01d144f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.706432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9b1415b3b84a65af2885c01d144f65'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:07.713822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1084/2168] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:07 2022] DELETE /identity/v3/users/be9b1415b3b84a65af2885c01d144f65 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:07.722735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.723486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.726094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.760590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:07.763027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.841879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1085/2169] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:17:07.853626 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:07.856020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:07.938195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5bacf-4d3a-45ad-a6b1-883bfc0767f5 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:07.943232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:07.943849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:07.944125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:07.944392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:07.958023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:07.960611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:07.979317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1085/2170] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:08.400323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:08.400323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:08.409923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:08.409923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fdf89-e5fd-4b3a-882f-cc455e483f2a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:08.416745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:08.417893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:08.418217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:08.418519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] PATH_INFO: `/v3/projects/09ec9657f93b4df4a94366ffe7a1bfcf` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:08.419755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ec9657f93b4df4a94366ffe7a1bfcf)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:08.421696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:08.476667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ec9657f93b4df4a94366ffe7a1bfcf', 'request_id': 'req-30706e0a-e95e-4d4f-91ce-6b358bc19af1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.484862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ec9657f93b4df4a94366ffe7a1bfcf', 'request_id': 'req-30706e0a-e95e-4d4f-91ce-6b358bc19af1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.492404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ec9657f93b4df4a94366ffe7a1bfcf', 'request_id': 'req-30706e0a-e95e-4d4f-91ce-6b358bc19af1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.506386 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] The token cache is being invalidate because project 09ec9657f93b4df4a94366ffe7a1bfcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:08.506647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.507318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.508884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1086/2171] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:08 2022] DELETE /identity/v3/projects/09ec9657f93b4df4a94366ffe7a1bfcf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:17:08.516117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:08.536302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114863cc-da3d-4aee-a6e4-74e90c3d2a05 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:08.623238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:08.623630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:08.623914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:08.624191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] PATH_INFO: `/v3/users/d3ec6fd8a1304181a2cf07a6e8d6e30b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:08.625416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ec6fd8a1304181a2cf07a6e8d6e30b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:08.627487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:08.664569 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:08.693698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ec6fd8a1304181a2cf07a6e8d6e30b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.712301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ec6fd8a1304181a2cf07a6e8d6e30b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.723525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ec6fd8a1304181a2cf07a6e8d6e30b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.733796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ec6fd8a1304181a2cf07a6e8d6e30b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.734828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ec6fd8a1304181a2cf07a6e8d6e30b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:08.742448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1086/2172] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:08 2022] DELETE /identity/v3/users/d3ec6fd8a1304181a2cf07a6e8d6e30b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:09.071850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.074181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.091876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30706e0a-e95e-4d4f-91ce-6b358bc19af1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.160772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.161431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.161705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.161982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] PATH_INFO: `/v3/projects/95ad6bc3d379414c9c65c9bc622a7e31` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.163167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ad6bc3d379414c9c65c9bc622a7e31)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.165127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.225533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ad6bc3d379414c9c65c9bc622a7e31', 'request_id': 'req-c9173c87-66c6-4563-b3ea-cbf878f84feb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.234398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ad6bc3d379414c9c65c9bc622a7e31', 'request_id': 'req-c9173c87-66c6-4563-b3ea-cbf878f84feb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.241409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ad6bc3d379414c9c65c9bc622a7e31', 'request_id': 'req-c9173c87-66c6-4563-b3ea-cbf878f84feb'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.254153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] The token cache is being invalidate because project 95ad6bc3d379414c9c65c9bc622a7e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:09.254830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.255360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.256991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1087/2173] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:09 2022] DELETE /identity/v3/projects/95ad6bc3d379414c9c65c9bc622a7e31 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:09.261297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.263711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.276897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe4904-902b-4505-a1d2-b4251eda0b7f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.336572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.337214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.337497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.337776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] PATH_INFO: `/v3/users/809d7aedd24441cda513ae238a63c8cb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.338945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=809d7aedd24441cda513ae238a63c8cb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.341067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.397796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809d7aedd24441cda513ae238a63c8cb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.420722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809d7aedd24441cda513ae238a63c8cb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.432024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809d7aedd24441cda513ae238a63c8cb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.442764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809d7aedd24441cda513ae238a63c8cb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.443520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-acaec412-cc39-48b5-a268-263115e340ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809d7aedd24441cda513ae238a63c8cb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.451652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1087/2174] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:09 2022] DELETE /identity/v3/users/809d7aedd24441cda513ae238a63c8cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:09.775638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:09.778792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:09.803126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9173c87-66c6-4563-b3ea-cbf878f84feb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:09.829663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:09.902189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:09.902867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:09.903697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:09.904084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] PATH_INFO: `/v3/projects/8f4b9d67577440b68a4dd0999269cdbf` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:09.905289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4b9d67577440b68a4dd0999269cdbf)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:09.907299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:09.971866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4b9d67577440b68a4dd0999269cdbf', 'request_id': 'req-cec6851d-31a6-499b-a251-de1986c8cf6b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.985519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4b9d67577440b68a4dd0999269cdbf', 'request_id': 'req-cec6851d-31a6-499b-a251-de1986c8cf6b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:09.993610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4b9d67577440b68a4dd0999269cdbf', 'request_id': 'req-cec6851d-31a6-499b-a251-de1986c8cf6b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.005613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] The token cache is being invalidate because project 8f4b9d67577440b68a4dd0999269cdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:10.005884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.006637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-cec6851d-31a6-499b-a251-de1986c8cf6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.008265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1088/2175] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:09 2022] DELETE /identity/v3/projects/8f4b9d67577440b68a4dd0999269cdbf => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:10.016390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5aaa-74d1-42fe-a5b2-d67eef016a31 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.016390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5aaa-74d1-42fe-a5b2-d67eef016a31 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.017702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a5aaa-74d1-42fe-a5b2-d67eef016a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.040116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d32a5aaa-74d1-42fe-a5b2-d67eef016a31 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:10.041387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d32a5aaa-74d1-42fe-a5b2-d67eef016a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:10.066359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:10.119658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1088/2176] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:10.128389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69608147-875a-427c-98d4-97b575806823 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.129191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69608147-875a-427c-98d4-97b575806823 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.129191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69608147-875a-427c-98d4-97b575806823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.151646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-69608147-875a-427c-98d4-97b575806823 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:10.152918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-69608147-875a-427c-98d4-97b575806823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:10.162078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1089/2177] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:10.166785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a5aaa-74d1-42fe-a5b2-d67eef016a31 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.180189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a5aaa-74d1-42fe-a5b2-d67eef016a31 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.186975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.187715 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.188075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.188423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.189186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:17:10.189561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.191401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.206469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1089/2178] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:17:10.211099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69608147-875a-427c-98d4-97b575806823 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.222598 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69608147-875a-427c-98d4-97b575806823 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.227511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.228142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.228424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.228701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.229352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.231843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.263899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1090/2179] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:10 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:10.268257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.279459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e68eda-1f97-469a-96bd-f4a6d3c2cf54 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.360193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.360802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.362520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.362827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.363504 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.365544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.388280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1090/2180] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:10 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:17:10.392510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.402887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af130c1-4690-462e-8f7e-831da60744fc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.408622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.409227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.409522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.409782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.410472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.412105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.422755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1091/2181] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:10.426777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.436887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0941fb-5cfc-4239-856e-053f2ac61605 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.441533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882f21-7a2d-4f64-bd07-cd2c7765cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.442123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882f21-7a2d-4f64-bd07-cd2c7765cafd admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.442436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882f21-7a2d-4f64-bd07-cd2c7765cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.442707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882f21-7a2d-4f64-bd07-cd2c7765cafd admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.443347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9882f21-7a2d-4f64-bd07-cd2c7765cafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.444956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9882f21-7a2d-4f64-bd07-cd2c7765cafd admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.458879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1091/2182] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:10.463466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.475391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58418fb2-e943-4111-9e94-b1fff7369d3d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.481376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.482080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.482596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.482903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] PATH_INFO: `/v3/projects/93d8b116162e447d9ea6037999d9ac3e/users/9ae1cdc4d6b0455c82e5e67308da406c/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.502842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d8b116162e447d9ea6037999d9ac3e, user_id=9ae1cdc4d6b0455c82e5e67308da406c, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.505628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.522387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1092/2183] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:10 2022] PUT /identity/v3/projects/93d8b116162e447d9ea6037999d9ac3e/users/9ae1cdc4d6b0455c82e5e67308da406c/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:10.533172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ceb72-7098-4d47-b94d-a90a025af4d3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.533464 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ceb72-7098-4d47-b94d-a90a025af4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.533768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ceb72-7098-4d47-b94d-a90a025af4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.567652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-636ceb72-7098-4d47-b94d-a90a025af4d3 None None] MFA Rules not processed for user `9ae1cdc4d6b0455c82e5e67308da406c`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:10.569054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-636ceb72-7098-4d47-b94d-a90a025af4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:10.644721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1092/2184] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:10.655867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.657588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:10.704514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:10.718064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef628a-fa80-4eab-a3cf-49999fe5c98a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.724311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35475131-1430-4987-9e72-23db424236ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.725621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475131-1430-4987-9e72-23db424236ea service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.725621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475131-1430-4987-9e72-23db424236ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.725839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35475131-1430-4987-9e72-23db424236ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.736469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35475131-1430-4987-9e72-23db424236ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.737919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35475131-1430-4987-9e72-23db424236ea service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.749163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1093/2185] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:10.774635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ceb72-7098-4d47-b94d-a90a025af4d3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:10.796790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:10.847849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ceb72-7098-4d47-b94d-a90a025af4d3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:10.852664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:10.853308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.853584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.853854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] PATH_INFO: `/v3/users/9ae1cdc4d6b0455c82e5e67308da406c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.855035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae1cdc4d6b0455c82e5e67308da406c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:10.857486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:10.910408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae1cdc4d6b0455c82e5e67308da406c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.924483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae1cdc4d6b0455c82e5e67308da406c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.932689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae1cdc4d6b0455c82e5e67308da406c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.942720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae1cdc4d6b0455c82e5e67308da406c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.943704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae1cdc4d6b0455c82e5e67308da406c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:10.950854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1093/2186] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:17:10 2022] DELETE /identity/v3/users/9ae1cdc4d6b0455c82e5e67308da406c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:10.955499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:10.955817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:10.956116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:10.978462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:10.980113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:11.048114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1094/2187] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:11.057830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:11.059406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:11.116951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2480d-9e6c-4eda-a552-f5cadfc4bef6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:11.120710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c7e7f-666d-4cb4-803e-d2580acd48f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:11.121314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c7e7f-666d-4cb4-803e-d2580acd48f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.121591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c7e7f-666d-4cb4-803e-d2580acd48f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.122540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c7e7f-666d-4cb4-803e-d2580acd48f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.131846 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c7e7f-666d-4cb4-803e-d2580acd48f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:11.133261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c7e7f-666d-4cb4-803e-d2580acd48f4 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:11.143305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1094/2188] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:11.456720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:11.458347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:11.473705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299171-0ee6-4274-9359-94063a9c4c33 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:11.479255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:11.479680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.480054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.480421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] PATH_INFO: `/v3/projects/93d8b116162e447d9ea6037999d9ac3e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.482857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d8b116162e447d9ea6037999d9ac3e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:11.485120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:11.550684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d8b116162e447d9ea6037999d9ac3e', 'request_id': 'req-2812922a-cd79-40d9-8753-6897404b80b4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:11.562518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d8b116162e447d9ea6037999d9ac3e', 'request_id': 'req-2812922a-cd79-40d9-8753-6897404b80b4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:11.571057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d8b116162e447d9ea6037999d9ac3e', 'request_id': 'req-2812922a-cd79-40d9-8753-6897404b80b4'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:11.583026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] The token cache is being invalidate because project 93d8b116162e447d9ea6037999d9ac3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:17:11.583310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:11.583967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2812922a-cd79-40d9-8753-6897404b80b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:17:11.585459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1095/2189] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:17:11 2022] DELETE /identity/v3/projects/93d8b116162e447d9ea6037999d9ac3e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:11.591170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc3126-1a2a-4525-b69a-649342c0be04 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.591452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc3126-1a2a-4525-b69a-649342c0be04 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.591723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc3126-1a2a-4525-b69a-649342c0be04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.613586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-33dc3126-1a2a-4525-b69a-649342c0be04 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:11.614883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-33dc3126-1a2a-4525-b69a-649342c0be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:11.656883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:11.686795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1095/2190] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:11.695133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20cca-9397-46a6-befd-b36fb4ee21f8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.695421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20cca-9397-46a6-befd-b36fb4ee21f8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.695703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b20cca-9397-46a6-befd-b36fb4ee21f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.719539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-85b20cca-9397-46a6-befd-b36fb4ee21f8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:11.720941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-85b20cca-9397-46a6-befd-b36fb4ee21f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:11.729393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1096/2191] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:11.734436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc3126-1a2a-4525-b69a-649342c0be04 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:11.744914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc3126-1a2a-4525-b69a-649342c0be04 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:11.749658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:11.750373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.750722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.751066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.751729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:17:11.752029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:11.753625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:11.766083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1096/2192] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:17:11.770492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20cca-9397-46a6-befd-b36fb4ee21f8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:11.780812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b20cca-9397-46a6-befd-b36fb4ee21f8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:11.785638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:11.786233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.786547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.786821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.787452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:11.789364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:11.819671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1097/2193] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:17:11 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:11.823827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:11.835178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3e215-e058-488d-9132-31e64a9a5c47 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:11.896879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:11.897497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.897780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.898058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.898746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:11.900691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:11.925014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1097/2194] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:17:11 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:17:11.928943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:11.939535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14afb4-69e6-4c9e-be71-3ef7cd6cd53f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:11.944140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:11.944730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.945004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.945270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.945903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:11.947516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:11.958203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1098/2195] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:11.962111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:11.972608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f220e6-4ada-48a7-9728-e42eaadbc34f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:11.977173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499b1a0-be71-4ae5-94d0-159516087bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:11.977758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b1a0-be71-4ae5-94d0-159516087bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:11.978035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b1a0-be71-4ae5-94d0-159516087bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:11.978342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499b1a0-be71-4ae5-94d0-159516087bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:11.978975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499b1a0-be71-4ae5-94d0-159516087bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:11.980554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499b1a0-be71-4ae5-94d0-159516087bc4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:11.991860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1098/2196] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:17:11.995997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:12.007004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3161629e-c25f-488e-a985-21509e803c6a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:12.012239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:12.012239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:12.012239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:12.012239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] PATH_INFO: `/v3/projects/9f0017ecddbc4c988687d7dbee74787d/users/b9388b6b0c0148988890e5c877f12825/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:12.031477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0017ecddbc4c988687d7dbee74787d, user_id=b9388b6b0c0148988890e5c877f12825, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:12.034226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:12.048265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1099/2197] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:17:11 2022] PUT /identity/v3/projects/9f0017ecddbc4c988687d7dbee74787d/users/b9388b6b0c0148988890e5c877f12825/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:17:12.065890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafdd70-711c-4583-b5cf-2239045bada3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:12.066368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafdd70-711c-4583-b5cf-2239045bada3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:12.066641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafdd70-711c-4583-b5cf-2239045bada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:12.103785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4cafdd70-711c-4583-b5cf-2239045bada3 None None] MFA Rules not processed for user `b9388b6b0c0148988890e5c877f12825`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:12.104976 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4cafdd70-711c-4583-b5cf-2239045bada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:12.172421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1099/2198] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:12.182968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:17:12.185422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:12.192102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:12.247758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47303d61-6012-4abe-b896-05974dc567c4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:17:12.251537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:17:12.252148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:12.252453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:12.252797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:12.261228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:17:12.263407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:17:12.272383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1100/2199] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:17:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:17:13.684049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:17:13.685187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:17:13.685187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:17:13.705675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] MFA Rules not processed for user `b9388b6b0c0148988890e5c877f12825`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:17:13.706934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:17:13.713873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1100/2200] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:17:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:17:22.268252 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=24 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:17:23.699017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:19:35.499546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:19:35.501804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:35.603161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0133646-26b9-4a19-b9af-a90f13520891 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:19:35.609061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:19:35.609843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:19:35.610407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:19:35.610686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:19:35.612601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:19:35.627411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:19:35.630942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:19:35.642827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1101/2201] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:19:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:19:45.637885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=32 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:26.344864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:26.346280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:26.424423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd085c-f9b5-4b12-9b87-0923a0193887 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:26.431160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:26.432205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:26.432708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:26.433206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:26.436218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:26.539099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:26.540617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:26.552779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1101/2202] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:20:28.845258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:28.860963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae56a2-ee60-4bd4-9942-08e901a1d038 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:28.867040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:28.868069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:28.868557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:28.868958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:28.871718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:28.890690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:28.892136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:28.905953 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1102/2203] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:20:36.547305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=54 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:36.628449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:36.630140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:36.644675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6387bb8-a7f5-42c3-b5d9-2f78127559bd service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:36.650182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:36.650912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:36.651186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:36.651461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:36.653199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:36.720479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:36.722064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:36.731406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1102/2204] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:20:38.899478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:41.119195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:41.121459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:41.135164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b680eb2-d36b-4f89-8d7e-c7e23202b438 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:41.141064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:41.141642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:41.141920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:41.142189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:41.143885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:41.216238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:41.217781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:41.227732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1103/2205] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:20:45.797954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:45.809553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92692e0-efcd-4d5e-8d89-7c6a8f952e57 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:45.815229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:45.815924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:45.816214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:45.816487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:45.818608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:45.883425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:45.885528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:45.894872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1103/2206] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:20:46.829745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:20:46.841043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a576834-ae83-4744-ab80-b87d2cfef4a3 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:20:46.846823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702f29b-0eb6-485a-b6c3-5945137724c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:20:46.847369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f29b-0eb6-485a-b6c3-5945137724c2 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:20:46.847642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f29b-0eb6-485a-b6c3-5945137724c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:20:46.847912 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702f29b-0eb6-485a-b6c3-5945137724c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:20:46.849644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a702f29b-0eb6-485a-b6c3-5945137724c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:20:46.917846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702f29b-0eb6-485a-b6c3-5945137724c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:20:46.919498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702f29b-0eb6-485a-b6c3-5945137724c2 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:20:46.929384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1104/2207] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:20:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:20:55.890469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=56 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:20:56.924766 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=56 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:15.217234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:15.229046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404f669-8953-431f-b716-f0dab6cc0935 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:15.235507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345856af-775e-46cd-ba94-37ce0f65095d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:15.236120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345856af-775e-46cd-ba94-37ce0f65095d service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:15.236406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345856af-775e-46cd-ba94-37ce0f65095d service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:15.236683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345856af-775e-46cd-ba94-37ce0f65095d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:15.238471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-345856af-775e-46cd-ba94-37ce0f65095d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:15.299895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345856af-775e-46cd-ba94-37ce0f65095d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:15.301468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345856af-775e-46cd-ba94-37ce0f65095d service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:15.311455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1104/2208] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:25.306443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=28 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:42.454228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4699aa-30c4-46bb-980b-de409010998f None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:42.455055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4699aa-30c4-46bb-980b-de409010998f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:42.455055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4699aa-30c4-46bb-980b-de409010998f None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:42.456147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1105/2209] 10.222.0.36 () {54 vars in 912 bytes} [Thu Sep 1 08:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:21:42.462094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268e6b-0381-4c43-9e64-466686a5e733 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:42.462606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268e6b-0381-4c43-9e64-466686a5e733 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:42.462822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268e6b-0381-4c43-9e64-466686a5e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:42.485933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-49268e6b-0381-4c43-9e64-466686a5e733 None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:42.487393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-49268e6b-0381-4c43-9e64-466686a5e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:42.498132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1105/2210] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:21:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:42.535417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4699aa-30c4-46bb-980b-de409010998f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:42.551292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4699aa-30c4-46bb-980b-de409010998f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:42.556503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced07bcc-fe92-41c9-b357-3c56f581b3c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:42.557118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced07bcc-fe92-41c9-b357-3c56f581b3c6 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:42.557399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced07bcc-fe92-41c9-b357-3c56f581b3c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:42.557693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced07bcc-fe92-41c9-b357-3c56f581b3c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:42.566895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced07bcc-fe92-41c9-b357-3c56f581b3c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:42.568531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced07bcc-fe92-41c9-b357-3c56f581b3c6 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:42.580391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1106/2211] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:42.901583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268e6b-0381-4c43-9e64-466686a5e733 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:42.911407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268e6b-0381-4c43-9e64-466686a5e733 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:42.915145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cc23b-5239-4f72-ba6e-73ba5624053e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:42.915752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cc23b-5239-4f72-ba6e-73ba5624053e service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:42.916034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cc23b-5239-4f72-ba6e-73ba5624053e service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:42.916306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cc23b-5239-4f72-ba6e-73ba5624053e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:42.918048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-774cc23b-5239-4f72-ba6e-73ba5624053e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:42.981396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cc23b-5239-4f72-ba6e-73ba5624053e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:42.982887 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cc23b-5239-4f72-ba6e-73ba5624053e service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:42.992558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1106/2212] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:47.141536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150036-8a97-4d99-bf5c-15ff7b57de5b None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.142075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150036-8a97-4d99-bf5c-15ff7b57de5b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.142751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1150036-8a97-4d99-bf5c-15ff7b57de5b None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.144328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1107/2213] 10.222.0.36 () {54 vars in 921 bytes} [Thu Sep 1 08:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:21:47.286548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4ad0-c8f0-4323-a4a2-592d887f9e46 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.287133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4ad0-c8f0-4323-a4a2-592d887f9e46 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.287234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e4ad0-c8f0-4323-a4a2-592d887f9e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.310388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-351e4ad0-c8f0-4323-a4a2-592d887f9e46 None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:47.311627 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-351e4ad0-c8f0-4323-a4a2-592d887f9e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:47.320991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1107/2214] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Sep 1 08:21:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:47.323504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1150036-8a97-4d99-bf5c-15ff7b57de5b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:47.325439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a1150036-8a97-4d99-bf5c-15ff7b57de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:47.339612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83370-a933-4672-b26a-ec9c9cc8df49 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.340088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83370-a933-4672-b26a-ec9c9cc8df49 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.340574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83370-a933-4672-b26a-ec9c9cc8df49 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.343339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1150036-8a97-4d99-bf5c-15ff7b57de5b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:47.344062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1108/2215] 10.222.0.36 () {54 vars in 961 bytes} [Thu Sep 1 08:21:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:21:47.349974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb556bdf-7542-4b26-8fbf-952fb9f1be5e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.350493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb556bdf-7542-4b26-8fbf-952fb9f1be5e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.351221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb556bdf-7542-4b26-8fbf-952fb9f1be5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.352847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:47.353476 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.353756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.354034 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] PATH_INFO: `/v3/users/5836a21647964f308aca34b92fb28f15` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.355225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] RBAC: Authorizing `identity:delete_user(user_id=5836a21647964f308aca34b92fb28f15)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:47.358407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:47.375039 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-cb556bdf-7542-4b26-8fbf-952fb9f1be5e None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:47.376267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cb556bdf-7542-4b26-8fbf-952fb9f1be5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:47.384867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1109/2216] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Sep 1 08:21:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:21:47.393022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb556bdf-7542-4b26-8fbf-952fb9f1be5e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:47.403118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb556bdf-7542-4b26-8fbf-952fb9f1be5e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:47.409796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:47.410462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.410762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.411003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.421388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:47.423031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:47.423240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5836a21647964f308aca34b92fb28f15'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.433251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1110/2217] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:21:47.436322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5836a21647964f308aca34b92fb28f15'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.444216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5836a21647964f308aca34b92fb28f15'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.444936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5836a21647964f308aca34b92fb28f15'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.453477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1948e311-cc14-4f1a-98cf-6b26153beada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5836a21647964f308aca34b92fb28f15'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.460623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1108/2218] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:21:47 2022] DELETE /identity/v3/users/5836a21647964f308aca34b92fb28f15 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:21:47.642732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:47.657273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f081-7b5a-4ae3-814b-b44bce12ca83 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:47.717937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:47.718604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.718885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.719167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] PATH_INFO: `/v3/projects/b04f4d69109f418e94c4a75a222367f3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.720281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04f4d69109f418e94c4a75a222367f3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:47.722190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:47.768882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04f4d69109f418e94c4a75a222367f3', 'request_id': 'req-2211824c-67dd-49dd-ad5e-f1882fe60f0b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.776758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04f4d69109f418e94c4a75a222367f3', 'request_id': 'req-2211824c-67dd-49dd-ad5e-f1882fe60f0b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.783314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04f4d69109f418e94c4a75a222367f3', 'request_id': 'req-2211824c-67dd-49dd-ad5e-f1882fe60f0b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.785319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:47.796641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] The token cache is being invalidate because project b04f4d69109f418e94c4a75a222367f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:21:47.796923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.797560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2211824c-67dd-49dd-ad5e-f1882fe60f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:21:47.799083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1111/2219] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:21:47 2022] DELETE /identity/v3/projects/b04f4d69109f418e94c4a75a222367f3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:21:47.804982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45479f5-5cad-4466-8398-2a0a968de9ee None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.805300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45479f5-5cad-4466-8398-2a0a968de9ee None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.805601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45479f5-5cad-4466-8398-2a0a968de9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.827187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c45479f5-5cad-4466-8398-2a0a968de9ee None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:47.828342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c45479f5-5cad-4466-8398-2a0a968de9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:47.897775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1109/2220] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:47.905893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904860b-012f-49c8-a47c-1eb363559948 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.906291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904860b-012f-49c8-a47c-1eb363559948 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.906583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904860b-012f-49c8-a47c-1eb363559948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.928368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9904860b-012f-49c8-a47c-1eb363559948 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:47.929807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9904860b-012f-49c8-a47c-1eb363559948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:47.939729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1112/2221] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:47.943714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45479f5-5cad-4466-8398-2a0a968de9ee None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:47.953586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45479f5-5cad-4466-8398-2a0a968de9ee None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:47.958135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:47.958768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.959043 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.959312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.959956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:21:47.960252 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:47.961844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:47.974341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1110/2222] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:21:47.979159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904860b-012f-49c8-a47c-1eb363559948 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:47.989044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904860b-012f-49c8-a47c-1eb363559948 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:47.993863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:47.994526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:47.994813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:47.995088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:47.995775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:47.998830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:48.032809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1113/2223] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:21:47 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:21:48.034564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:48.045361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c41648-9243-4b6e-bc82-df83559c45b9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:48.090539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:48.105981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:48.107211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:48.107467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:48.107746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:48.108389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:48.110350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:48.135474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1111/2224] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:21:48 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:21:48.136660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:48.148776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf2ab7-183f-4ab2-b0fa-fc5349180f44 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:48.154839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:48.155451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:48.155726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:48.155996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:48.156672 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:48.158269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:48.172255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1114/2225] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:21:48.173413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:48.183786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058a2a-175f-41d8-b185-99ffefcbf938 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:48.189511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79629e8-9520-497a-b55f-d00256ac68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:48.190138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79629e8-9520-497a-b55f-d00256ac68e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:48.190492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79629e8-9520-497a-b55f-d00256ac68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:48.190764 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79629e8-9520-497a-b55f-d00256ac68e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:48.191442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79629e8-9520-497a-b55f-d00256ac68e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:48.193026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79629e8-9520-497a-b55f-d00256ac68e8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:48.205425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1112/2226] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:21:48.209440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:48.226657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13506813-6a68-4df8-8ebf-f971cdf49ce9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:48.233875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:48.234634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:48.234917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:48.235193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] PATH_INFO: `/v3/projects/9ed1bc7f289940728f3f80d2d79588a3/users/b637e39164d5418f88eb442894c2ad46/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:48.252617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed1bc7f289940728f3f80d2d79588a3, user_id=b637e39164d5418f88eb442894c2ad46, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:48.255598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:48.270855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1115/2227] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:21:48 2022] PUT /identity/v3/projects/9ed1bc7f289940728f3f80d2d79588a3/users/b637e39164d5418f88eb442894c2ad46/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:21:48.276031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d81b-65b4-4d75-915c-bf023874484e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:48.276293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d81b-65b4-4d75-915c-bf023874484e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:48.276560 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6d81b-65b4-4d75-915c-bf023874484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:48.297765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-34c6d81b-65b4-4d75-915c-bf023874484e None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:48.299027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34c6d81b-65b4-4d75-915c-bf023874484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:48.366980 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1113/2228] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:48.378019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:48.379996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:48.440739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aab08-b423-484f-88ac-49899742b871 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:48.445088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:48.445705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:48.445981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:48.446270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:48.456655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:48.458287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:48.468735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1116/2229] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:52.885508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a5a3-31a7-465c-96be-e0ce69d54638 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:52.886380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a5a3-31a7-465c-96be-e0ce69d54638 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:52.886380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5a5a3-31a7-465c-96be-e0ce69d54638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:52.929002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-93e5a5a3-31a7-465c-96be-e0ce69d54638 None None] MFA Rules not processed for user `b637e39164d5418f88eb442894c2ad46`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:52.931028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-93e5a5a3-31a7-465c-96be-e0ce69d54638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:53.077094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1114/2230] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:21:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:53.084926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:53.086478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:53.244628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1bb0d-cf64-48e5-8f7b-242adc137999 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:53.253939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:53.255539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:53.255832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:53.256103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:53.267468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:53.269233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:53.273741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d08f-a3d7-4710-806a-b90cf439e004 None None] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:53.274026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d08f-a3d7-4710-806a-b90cf439e004 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:53.274354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d08f-a3d7-4710-806a-b90cf439e004 None None] PATH_INFO: `/` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:53.275700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1115/2231] 10.222.0.36 () {54 vars in 912 bytes} [Thu Sep 1 08:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 08:21:53.281282 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1117/2232] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:53.281572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac3e6-7944-4e2c-91ee-d847370b7bd8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:53.281971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac3e6-7944-4e2c-91ee-d847370b7bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:53.282122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77ac3e6-7944-4e2c-91ee-d847370b7bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:53.305565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c77ac3e6-7944-4e2c-91ee-d847370b7bd8 None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:53.306833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c77ac3e6-7944-4e2c-91ee-d847370b7bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:53.371594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:53.398344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1116/2233] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:21:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:53.425087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:53.426789 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:53.443958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179c109-5e56-4123-b2fe-d70267a7e12d service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:53.450743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:53.451920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:53.452395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:53.452691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:53.463649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:53.465293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:53.477901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1118/2234] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:55.398652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e40f-5692-4efa-a8c2-a920ffe2c104 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:55.399444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e40f-5692-4efa-a8c2-a920ffe2c104 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:55.399444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e40f-5692-4efa-a8c2-a920ffe2c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:55.421351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6bb8e40f-5692-4efa-a8c2-a920ffe2c104 None None] MFA Rules not processed for user `b637e39164d5418f88eb442894c2ad46`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:55.426325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6bb8e40f-5692-4efa-a8c2-a920ffe2c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:55.432867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1117/2235] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:21:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:21:55.860479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:55.865952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:21:55.873345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcd9f8-ca61-4d76-919f-aec78cd42a33 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:55.884681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c0bdb-6ac3-4d15-a380-63cfb1e17ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:55.885556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c0bdb-6ac3-4d15-a380-63cfb1e17ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:55.886014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c0bdb-6ac3-4d15-a380-63cfb1e17ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:55.886453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c0bdb-6ac3-4d15-a380-63cfb1e17ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:55.889222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bd2c0bdb-6ac3-4d15-a380-63cfb1e17ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:55.899600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c0bdb-6ac3-4d15-a380-63cfb1e17ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:55.901723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c0bdb-6ac3-4d15-a380-63cfb1e17ab9 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:55.916521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1119/2236] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:56.397300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e40f-5692-4efa-a8c2-a920ffe2c104 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:56.412247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e40f-5692-4efa-a8c2-a920ffe2c104 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:56.422786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:56.423651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:56.424103 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:56.424529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:56.427193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:56.459754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:56.461614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:56.479492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1118/2237] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:21:56.753431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c0f7-20a2-45bf-8ada-75d143e63d3d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:56.753724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c0f7-20a2-45bf-8ada-75d143e63d3d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:56.754003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c0f7-20a2-45bf-8ada-75d143e63d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:56.781785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4962c0f7-20a2-45bf-8ada-75d143e63d3d None None] MFA Rules not processed for user `93c8237bd14c40dda53daecb949a33ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:21:56.783281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4962c0f7-20a2-45bf-8ada-75d143e63d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:56.874273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1120/2238] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:21:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:21:57.378740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:57.397715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32c92d-bbc7-42e3-8be6-54a0c0d3d44a service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:57.411037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd8923-8ef2-439f-a032-139582faa310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:57.420019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8923-8ef2-439f-a032-139582faa310 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:57.421184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8923-8ef2-439f-a032-139582faa310 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:57.421703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd8923-8ef2-439f-a032-139582faa310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:57.430319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7fcd8923-8ef2-439f-a032-139582faa310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:57.447800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8923-8ef2-439f-a032-139582faa310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:57.451543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd8923-8ef2-439f-a032-139582faa310 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:57.465072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c0f7-20a2-45bf-8ada-75d143e63d3d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:21:57.480465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962c0f7-20a2-45bf-8ada-75d143e63d3d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:21:57.480691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1119/2239] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:21:57.490708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:21:57.491816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:21:57.491816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:21:57.492181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:21:57.494328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:21:57.508663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:21:57.510726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:21:57.522186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1121/2240] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:21:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:00.900575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42676f-fd7b-454d-b349-f210a62a29a0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:00.901214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42676f-fd7b-454d-b349-f210a62a29a0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:00.901615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42676f-fd7b-454d-b349-f210a62a29a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:00.936781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ac42676f-fd7b-454d-b349-f210a62a29a0 None None] MFA Rules not processed for user `98fc7b08006741ae9b0a217ce7fe8c92`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:00.939180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ac42676f-fd7b-454d-b349-f210a62a29a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:01.028493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1120/2241] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:01.333725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:01.335390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:01.364943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d869d4-876f-4b2b-93d6-8f7711a5147e service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:01.373792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:01.374584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:01.374960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:01.375331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] PATH_INFO: `/v3/users/2bc03f8cc95c4f2da66897f3150e7efb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:01.376586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc03f8cc95c4f2da66897f3150e7efb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:01.378647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:01.433274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc03f8cc95c4f2da66897f3150e7efb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.446029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc03f8cc95c4f2da66897f3150e7efb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.455977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc03f8cc95c4f2da66897f3150e7efb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.464331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc03f8cc95c4f2da66897f3150e7efb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.465072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-08b85bcf-d273-4e94-a83b-1f7e165f713e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc03f8cc95c4f2da66897f3150e7efb'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.476781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1122/2242] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:01 2022] DELETE /identity/v3/users/2bc03f8cc95c4f2da66897f3150e7efb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:01.662877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42676f-fd7b-454d-b349-f210a62a29a0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:01.677484 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42676f-fd7b-454d-b349-f210a62a29a0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:01.747471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:01.748117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:01.748426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:01.748935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] PATH_INFO: `/v3/projects/3de02deda353493f804a8123db6ab321` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:01.751757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de02deda353493f804a8123db6ab321)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:01.763576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:01.843842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de02deda353493f804a8123db6ab321', 'request_id': 'req-c8fd7d75-9646-4384-8601-b136411d08cf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.867797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de02deda353493f804a8123db6ab321', 'request_id': 'req-c8fd7d75-9646-4384-8601-b136411d08cf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.881521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de02deda353493f804a8123db6ab321', 'request_id': 'req-c8fd7d75-9646-4384-8601-b136411d08cf'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.887931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:01.898814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] The token cache is being invalidate because project 3de02deda353493f804a8123db6ab321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:01.899441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.900658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c8fd7d75-9646-4384-8601-b136411d08cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:01.904585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1121/2243] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:01 2022] DELETE /identity/v3/projects/3de02deda353493f804a8123db6ab321 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:01.914167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8173ef4-cff1-41a3-a16d-b987f63c20d4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:01.914525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8173ef4-cff1-41a3-a16d-b987f63c20d4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:01.914778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8173ef4-cff1-41a3-a16d-b987f63c20d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:01.949623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f8173ef4-cff1-41a3-a16d-b987f63c20d4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:01.952631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f8173ef4-cff1-41a3-a16d-b987f63c20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:02.023779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:02.043190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1123/2244] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:02.051345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c779c34-6016-46da-b82a-9e30c0137233 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.051703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c779c34-6016-46da-b82a-9e30c0137233 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.052098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c779c34-6016-46da-b82a-9e30c0137233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.073352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8c779c34-6016-46da-b82a-9e30c0137233 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:02.075279 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8c779c34-6016-46da-b82a-9e30c0137233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:02.084182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1122/2245] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:02.088599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8173ef4-cff1-41a3-a16d-b987f63c20d4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.100150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8173ef4-cff1-41a3-a16d-b987f63c20d4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:02.106308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:02.107153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.107424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.107690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.108340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:02.108644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:02.110276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:02.124579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1124/2246] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:02.129428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c779c34-6016-46da-b82a-9e30c0137233 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.141692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c779c34-6016-46da-b82a-9e30c0137233 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:02.146402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:02.147036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.147396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.147669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.148327 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:02.150283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:02.182889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1123/2247] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:02 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:02.187916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.204601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8b9a2-56d4-4de8-9de6-fb617789b202 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:02.284759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:02.285426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.285690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.285979 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.286680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:02.289276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:02.318129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1125/2248] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:02 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:02.320357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.330069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf2e7b-1899-42c3-85f2-460aad1dfffe admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:02.334847 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:02.335493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.335723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.335997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.336706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:02.338249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:02.349437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1124/2249] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:22:02.353958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.366352 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b08e3-2ad4-48d9-9732-9b0a165c00bc admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:02.371673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81106a-6e10-47d4-9dca-7cc47f777c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:02.372758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81106a-6e10-47d4-9dca-7cc47f777c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.373148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81106a-6e10-47d4-9dca-7cc47f777c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.373817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81106a-6e10-47d4-9dca-7cc47f777c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.374487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81106a-6e10-47d4-9dca-7cc47f777c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:02.376225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81106a-6e10-47d4-9dca-7cc47f777c4b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:02.387890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1126/2250] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:22:02.392112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.409133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c61e-361f-4ae2-bbe9-ede1983a475f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:02.414224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:02.414925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.415464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.415768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] PATH_INFO: `/v3/projects/40af9bb3eb4a4e6d8e7ad03ba5f91e44/users/802fbf3419dd42d1a444539c407086e7/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.436608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40af9bb3eb4a4e6d8e7ad03ba5f91e44, user_id=802fbf3419dd42d1a444539c407086e7, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:02.439789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:02.455988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1125/2251] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:02 2022] PUT /identity/v3/projects/40af9bb3eb4a4e6d8e7ad03ba5f91e44/users/802fbf3419dd42d1a444539c407086e7/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:02.467519 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628f2b-0215-41b7-af10-8c01b91a3668 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.467807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628f2b-0215-41b7-af10-8c01b91a3668 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.468078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df628f2b-0215-41b7-af10-8c01b91a3668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.503987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-df628f2b-0215-41b7-af10-8c01b91a3668 None None] MFA Rules not processed for user `802fbf3419dd42d1a444539c407086e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:02.505230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-df628f2b-0215-41b7-af10-8c01b91a3668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:02.603635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1127/2252] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:02.615108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.617077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:02.695276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670ce19-b66a-48a6-a78e-bb6eef3c4f5b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:02.701583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78404574-a7d3-4af4-b65e-1cadd9b4c417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:02.702190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404574-a7d3-4af4-b65e-1cadd9b4c417 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:02.702503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404574-a7d3-4af4-b65e-1cadd9b4c417 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:02.702779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78404574-a7d3-4af4-b65e-1cadd9b4c417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:02.710539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404574-a7d3-4af4-b65e-1cadd9b4c417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:02.712131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78404574-a7d3-4af4-b65e-1cadd9b4c417 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:02.721813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1126/2253] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:02.926151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df628f2b-0215-41b7-af10-8c01b91a3668 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:02.998957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:03.021742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df628f2b-0215-41b7-af10-8c01b91a3668 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:03.026780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:03.027560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.027882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.028523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] PATH_INFO: `/v3/users/802fbf3419dd42d1a444539c407086e7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.029906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=802fbf3419dd42d1a444539c407086e7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:03.031928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:03.082045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802fbf3419dd42d1a444539c407086e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.096003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802fbf3419dd42d1a444539c407086e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.105405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802fbf3419dd42d1a444539c407086e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.114316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802fbf3419dd42d1a444539c407086e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.115117 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802fbf3419dd42d1a444539c407086e7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.123194 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1128/2254] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:02 2022] DELETE /identity/v3/users/802fbf3419dd42d1a444539c407086e7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:03.128087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.129875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.129875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.151793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:03.153835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:03.219885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1127/2255] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:03.229807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:03.231323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:03.291618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c37d4f-5b36-4cc8-8395-9517bc1e6fc6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:03.295521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a18e82-4bdc-40c5-9fcf-5d144fdb1737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:03.296136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a18e82-4bdc-40c5-9fcf-5d144fdb1737 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.296418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a18e82-4bdc-40c5-9fcf-5d144fdb1737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.296686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a18e82-4bdc-40c5-9fcf-5d144fdb1737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.306719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a18e82-4bdc-40c5-9fcf-5d144fdb1737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:03.308162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a18e82-4bdc-40c5-9fcf-5d144fdb1737 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:03.319734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1129/2256] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:03.617817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:03.620391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:03.634657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5733fb-d41c-483f-8a52-bec6b268b174 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:03.640829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:03.641489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.641771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.642044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] PATH_INFO: `/v3/projects/40af9bb3eb4a4e6d8e7ad03ba5f91e44` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.643285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40af9bb3eb4a4e6d8e7ad03ba5f91e44)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:03.645283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:03.658829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:03.736701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40af9bb3eb4a4e6d8e7ad03ba5f91e44', 'request_id': 'req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.747416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40af9bb3eb4a4e6d8e7ad03ba5f91e44', 'request_id': 'req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.755523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40af9bb3eb4a4e6d8e7ad03ba5f91e44', 'request_id': 'req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.770284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] The token cache is being invalidate because project 40af9bb3eb4a4e6d8e7ad03ba5f91e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:03.771307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.771992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b4ed9e34-b337-4a9d-8213-d7ed2959a78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:03.773511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1128/2257] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:03 2022] DELETE /identity/v3/projects/40af9bb3eb4a4e6d8e7ad03ba5f91e44 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:03.779066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10a425-b746-4946-9fa9-00a5e0d11cb8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.779532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10a425-b746-4946-9fa9-00a5e0d11cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.779817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10a425-b746-4946-9fa9-00a5e0d11cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.800475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fb10a425-b746-4946-9fa9-00a5e0d11cb8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:03.801682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fb10a425-b746-4946-9fa9-00a5e0d11cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:03.866749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1130/2258] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:03.875391 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9a9c4-970a-407f-a77b-72592a1533ff None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.875702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9a9c4-970a-407f-a77b-72592a1533ff None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.875979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9a9c4-970a-407f-a77b-72592a1533ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.895670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7df9a9c4-970a-407f-a77b-72592a1533ff None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:03.896890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7df9a9c4-970a-407f-a77b-72592a1533ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:03.905711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1129/2259] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:03.909997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10a425-b746-4946-9fa9-00a5e0d11cb8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:03.920225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10a425-b746-4946-9fa9-00a5e0d11cb8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:03.924731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:03.925319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.925593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.925866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.926553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:03.926836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:03.928418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:03.935186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:03.942284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1131/2260] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:03.946012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9a9c4-970a-407f-a77b-72592a1533ff None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:03.955745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9a9c4-970a-407f-a77b-72592a1533ff None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:03.960621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:03.961217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:03.961500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:03.961774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:03.962475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:03.964396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:03.992434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1130/2261] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:03 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:03.996830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.006858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5560a-938a-4de1-98d8-32bdc6436db2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.092451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.093107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.093391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.093666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.094342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.096308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.128975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1132/2262] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:03 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:04.133099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.145235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcb8a2-65a7-4310-a57b-54019110ca48 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.150195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.151017 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.151494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.152166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.152929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.155193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.169948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1131/2263] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:22:04.171379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.181872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd7c52-11c6-4809-8019-cfe0379748e1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.187288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885fc1f-625e-40f3-b850-65af331a59d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.187893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fc1f-625e-40f3-b850-65af331a59d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.188193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fc1f-625e-40f3-b850-65af331a59d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.188465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885fc1f-625e-40f3-b850-65af331a59d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.189110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885fc1f-625e-40f3-b850-65af331a59d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.190751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885fc1f-625e-40f3-b850-65af331a59d7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.207212 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1133/2264] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:04.211507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.223746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464f26b-a5df-45c4-809b-c13a71396444 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.228772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.229443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.229727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.230014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] PATH_INFO: `/v3/projects/46d5f0c3e40546cb935ad8c7cfa1d8d4/users/671436f7f75948f496e5f13cb9661d3e/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.248423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d5f0c3e40546cb935ad8c7cfa1d8d4, user_id=671436f7f75948f496e5f13cb9661d3e, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.251163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.266892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1132/2265] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:04 2022] PUT /identity/v3/projects/46d5f0c3e40546cb935ad8c7cfa1d8d4/users/671436f7f75948f496e5f13cb9661d3e/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:04.279077 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a592a0e-4877-44c0-ae18-d39cb10c1f31 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.279354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a592a0e-4877-44c0-ae18-d39cb10c1f31 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.279624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a592a0e-4877-44c0-ae18-d39cb10c1f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.308746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1a592a0e-4877-44c0-ae18-d39cb10c1f31 None None] MFA Rules not processed for user `671436f7f75948f496e5f13cb9661d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:04.310576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1a592a0e-4877-44c0-ae18-d39cb10c1f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:04.376204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1134/2266] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:04.380733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.449184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eff78-6370-4028-9e35-486dc8618c9c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.455024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.455656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.455936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.456210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.456869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.458866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.487739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1133/2267] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:04 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:04.492210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a592a0e-4877-44c0-ae18-d39cb10c1f31 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.503821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a592a0e-4877-44c0-ae18-d39cb10c1f31 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.561677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.562309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.562595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.562870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.563513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.565439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.578164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:04.594745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1135/2268] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:04 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:04.598609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.609834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1499e5-2f97-477e-9eec-ae932ee296e1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.615277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.615922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.616208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.616480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.617124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.618772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.630602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1134/2269] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:04.634731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.645624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fafa4-6bdd-47da-b2ce-61ff788bf312 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.650408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.651128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.651405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.651710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] PATH_INFO: `/v3/projects/dcfbd413e3e048e1ac2acf5a7158bb6b/users/0de372b9e87c47b1a22348782d610622/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.667611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfbd413e3e048e1ac2acf5a7158bb6b, user_id=0de372b9e87c47b1a22348782d610622, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.670728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.689195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1136/2270] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:04 2022] PUT /identity/v3/projects/dcfbd413e3e048e1ac2acf5a7158bb6b/users/0de372b9e87c47b1a22348782d610622/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:04.693274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.704175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779ea2d-be85-4c4f-9536-ddc067ded55a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.708828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:04.764441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442f969-e02d-4b36-8e8f-67a761108455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.765055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442f969-e02d-4b36-8e8f-67a761108455 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.765334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442f969-e02d-4b36-8e8f-67a761108455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.765608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442f969-e02d-4b36-8e8f-67a761108455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.766278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442f969-e02d-4b36-8e8f-67a761108455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.767936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442f969-e02d-4b36-8e8f-67a761108455 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.781681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1135/2271] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:04.783506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.794496 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f576967-bd0b-4689-bbf8-5d74741f7688 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:04.799470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:04.800128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.800404 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.800676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] PATH_INFO: `/v3/projects/dcfbd413e3e048e1ac2acf5a7158bb6b/users/0de372b9e87c47b1a22348782d610622/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.802677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfbd413e3e048e1ac2acf5a7158bb6b, user_id=0de372b9e87c47b1a22348782d610622, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:04.805403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:04.822341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1137/2272] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:04 2022] PUT /identity/v3/projects/dcfbd413e3e048e1ac2acf5a7158bb6b/users/0de372b9e87c47b1a22348782d610622/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:04.829158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40333-6661-40f5-84cc-64164f2ed2b6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:04.829445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40333-6661-40f5-84cc-64164f2ed2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:04.829773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c40333-6661-40f5-84cc-64164f2ed2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:04.860901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-59c40333-6661-40f5-84cc-64164f2ed2b6 None None] MFA Rules not processed for user `0de372b9e87c47b1a22348782d610622`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:04.862108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-59c40333-6661-40f5-84cc-64164f2ed2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:04.943884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1136/2273] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:04.955469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:04.957178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:05.018526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c36297-bf4e-4c36-b96a-d22b0cbb59f8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:05.022342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81408c-46eb-474a-866b-eeff18a2e55a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:05.022952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81408c-46eb-474a-866b-eeff18a2e55a service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:05.023227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81408c-46eb-474a-866b-eeff18a2e55a service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:05.023502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81408c-46eb-474a-866b-eeff18a2e55a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:05.033321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81408c-46eb-474a-866b-eeff18a2e55a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:05.034783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81408c-46eb-474a-866b-eeff18a2e55a service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:05.044561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1138/2274] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:06.550428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c40333-6661-40f5-84cc-64164f2ed2b6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:06.623414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c40333-6661-40f5-84cc-64164f2ed2b6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:06.628127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:06.628773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:06.629055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:06.629332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] PATH_INFO: `/v3/users/671436f7f75948f496e5f13cb9661d3e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:06.630502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671436f7f75948f496e5f13cb9661d3e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:06.632456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:06.670868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:06.685383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671436f7f75948f496e5f13cb9661d3e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:06.699110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671436f7f75948f496e5f13cb9661d3e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:06.706545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671436f7f75948f496e5f13cb9661d3e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:06.707293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671436f7f75948f496e5f13cb9661d3e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:06.715019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671436f7f75948f496e5f13cb9661d3e'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:06.721390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1137/2275] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:06 2022] DELETE /identity/v3/users/671436f7f75948f496e5f13cb9661d3e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:06.725912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:06.726424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:06.726624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:06.746203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:06.748198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:06.811765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1139/2276] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:06.817852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:06.819542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:06.880372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79810354-7fbc-40ca-803b-346879c27e74 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:06.884097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:06.884711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:06.884994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:06.885270 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:06.899130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:06.900566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:06.910400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1138/2277] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:07.237281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:07.238767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:07.255735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbb9de-2b12-4868-ba94-b77f6a4f0e93 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:07.260594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:07.261263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:07.261536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:07.261806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] PATH_INFO: `/v3/projects/46d5f0c3e40546cb935ad8c7cfa1d8d4` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:07.263195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d5f0c3e40546cb935ad8c7cfa1d8d4)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:07.265153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:07.313514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d5f0c3e40546cb935ad8c7cfa1d8d4', 'request_id': 'req-2e40825f-469c-40f3-bfda-4e060fb35916'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.320906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d5f0c3e40546cb935ad8c7cfa1d8d4', 'request_id': 'req-2e40825f-469c-40f3-bfda-4e060fb35916'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.322198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:07.329187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d5f0c3e40546cb935ad8c7cfa1d8d4', 'request_id': 'req-2e40825f-469c-40f3-bfda-4e060fb35916'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.340201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] The token cache is being invalidate because project 46d5f0c3e40546cb935ad8c7cfa1d8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:07.340520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.341184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.342727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1140/2278] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:07 2022] DELETE /identity/v3/projects/46d5f0c3e40546cb935ad8c7cfa1d8d4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:07.347750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:07.359150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e5ec3-1f8c-467d-8f8c-2eff5729a67c service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:07.424570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:07.425195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:07.425472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:07.425762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] PATH_INFO: `/v3/users/0de372b9e87c47b1a22348782d610622` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:07.426875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de372b9e87c47b1a22348782d610622)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:07.428817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:07.497731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de372b9e87c47b1a22348782d610622'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.504378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:07.516406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de372b9e87c47b1a22348782d610622'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.527696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de372b9e87c47b1a22348782d610622'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.529115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de372b9e87c47b1a22348782d610622'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.546718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-17ebef63-a6d9-46cb-b681-5e78a2a97294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de372b9e87c47b1a22348782d610622'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:07.561534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1139/2279] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:07 2022] DELETE /identity/v3/users/0de372b9e87c47b1a22348782d610622 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:07.864625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:07.866168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:07.879850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40825f-469c-40f3-bfda-4e060fb35916 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:07.941386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:07.942022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:07.942341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:07.942621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] PATH_INFO: `/v3/projects/dcfbd413e3e048e1ac2acf5a7158bb6b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:07.943755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfbd413e3e048e1ac2acf5a7158bb6b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:07.945709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:07.999449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfbd413e3e048e1ac2acf5a7158bb6b', 'request_id': 'req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:08.007431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfbd413e3e048e1ac2acf5a7158bb6b', 'request_id': 'req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:08.014482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfbd413e3e048e1ac2acf5a7158bb6b', 'request_id': 'req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:08.024870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] The token cache is being invalidate because project dcfbd413e3e048e1ac2acf5a7158bb6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:08.025154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:08.025784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-b15e1e0e-f34a-48a5-ab8a-eaf132d958e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:08.027318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1141/2280] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:07 2022] DELETE /identity/v3/projects/dcfbd413e3e048e1ac2acf5a7158bb6b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:08.032892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a717-1c55-4e8a-a57e-672d329f4a4b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.033180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a717-1c55-4e8a-a57e-672d329f4a4b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.033456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a717-1c55-4e8a-a57e-672d329f4a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.052881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-50b1a717-1c55-4e8a-a57e-672d329f4a4b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:08.054078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-50b1a717-1c55-4e8a-a57e-672d329f4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:08.116475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1140/2281] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:08.125416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b3227-8177-4274-bbd6-a54d05ef0c81 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.125704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b3227-8177-4274-bbd6-a54d05ef0c81 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.126006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b3227-8177-4274-bbd6-a54d05ef0c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.146839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f06b3227-8177-4274-bbd6-a54d05ef0c81 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:08.148377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f06b3227-8177-4274-bbd6-a54d05ef0c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:08.156965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1142/2282] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:08.161316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a717-1c55-4e8a-a57e-672d329f4a4b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.171535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a717-1c55-4e8a-a57e-672d329f4a4b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.176121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.176717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.177011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.177315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.178126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:08.178469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.180140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.193696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1141/2283] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:08.197971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b3227-8177-4274-bbd6-a54d05ef0c81 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.207265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b3227-8177-4274-bbd6-a54d05ef0c81 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.212096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.212731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.213010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.213280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.213913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.215889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.246001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1143/2284] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:08 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:08.248890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.258930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe84f11-60ba-4b69-96b7-590121ff1e0d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.315298 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.315891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.316167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.316434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.317059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.319003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.339669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1142/2285] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:08 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:08.344759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.355665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48cac2-dc8d-4ac1-b07c-4f6e74f2d956 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.361563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.362154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.362466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.362764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.363411 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.364981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.375848 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1144/2286] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:08.379749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.389735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa1e1e-8682-42fd-83c6-ac7574063984 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.394337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78add1e5-3028-4641-9bcf-58378297233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.394925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78add1e5-3028-4641-9bcf-58378297233c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.395205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78add1e5-3028-4641-9bcf-58378297233c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.395477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78add1e5-3028-4641-9bcf-58378297233c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.396111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78add1e5-3028-4641-9bcf-58378297233c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.397698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78add1e5-3028-4641-9bcf-58378297233c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.408843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1143/2287] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:08.412914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.423982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d76592-0550-4633-855b-261e0891e1eb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.428667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.429309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.429593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.429872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] PATH_INFO: `/v3/projects/f73d181954a54308922fcb061b2b3d3a/users/9644f0f1023941e882b363a48290ca33/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.446074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73d181954a54308922fcb061b2b3d3a, user_id=9644f0f1023941e882b363a48290ca33, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.448844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.463134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1145/2288] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:08 2022] PUT /identity/v3/projects/f73d181954a54308922fcb061b2b3d3a/users/9644f0f1023941e882b363a48290ca33/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:08.476232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae714b3-076f-4f2b-906a-a1ec86634ed8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.476516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae714b3-076f-4f2b-906a-a1ec86634ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.476788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae714b3-076f-4f2b-906a-a1ec86634ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.507440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dae714b3-076f-4f2b-906a-a1ec86634ed8 None None] MFA Rules not processed for user `9644f0f1023941e882b363a48290ca33`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:08.508681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dae714b3-076f-4f2b-906a-a1ec86634ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:08.537632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:08.587622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1144/2289] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:08.592486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.608986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:08.688992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817ef66-a98b-4f3a-bba3-553d2a8d1175 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.694158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.694823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.695105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.695382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.696088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.698026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.744685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1146/2290] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:08 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:08.747611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae714b3-076f-4f2b-906a-a1ec86634ed8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.763695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae714b3-076f-4f2b-906a-a1ec86634ed8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.826796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.827425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.827699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.827969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.828617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.830588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.852986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1145/2291] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:08 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:08.857847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.868661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9183748-39b2-4fe8-9dc3-bf51c37c05f9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.874205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.874930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.875256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.875576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.876331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.878113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.890220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1147/2292] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:22:08.894365 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.905431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a969a6-62dc-4098-9ca9-5c4fc508043d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:08.910973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:08.911661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:08.911936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:08.912218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] PATH_INFO: `/v3/projects/fa27db68c0284513a1eec07da7d5529f/users/0a20127366e34742a0f7883f8c0e4688/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:08.929141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa27db68c0284513a1eec07da7d5529f, user_id=0a20127366e34742a0f7883f8c0e4688, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:08.931894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:08.947058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1146/2293] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:08 2022] PUT /identity/v3/projects/fa27db68c0284513a1eec07da7d5529f/users/0a20127366e34742a0f7883f8c0e4688/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:08.952879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:08.968988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a265-0b37-4d07-a9a6-4566ad578b3e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:09.036358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ce5d7-f881-4584-b159-f3615b7ab226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:09.036971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ce5d7-f881-4584-b159-f3615b7ab226 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.037251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ce5d7-f881-4584-b159-f3615b7ab226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.037526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ce5d7-f881-4584-b159-f3615b7ab226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.038177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ce5d7-f881-4584-b159-f3615b7ab226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:09.039834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ce5d7-f881-4584-b159-f3615b7ab226 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:09.050879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1148/2294] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:09.055219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:09.066789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af907f-0675-43e9-84b9-e4ea672c85c6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:09.074562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:09.075389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.075854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.076222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] PATH_INFO: `/v3/projects/fa27db68c0284513a1eec07da7d5529f/users/0a20127366e34742a0f7883f8c0e4688/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.078655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa27db68c0284513a1eec07da7d5529f, user_id=0a20127366e34742a0f7883f8c0e4688, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:09.082384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:09.096726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1147/2295] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:09 2022] PUT /identity/v3/projects/fa27db68c0284513a1eec07da7d5529f/users/0a20127366e34742a0f7883f8c0e4688/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:09.106705 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298639b8-bf10-47a8-8066-fcd5c1c51570 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.106991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298639b8-bf10-47a8-8066-fcd5c1c51570 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.107269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298639b8-bf10-47a8-8066-fcd5c1c51570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.136661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-298639b8-bf10-47a8-8066-fcd5c1c51570 None None] MFA Rules not processed for user `0a20127366e34742a0f7883f8c0e4688`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:09.138827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-298639b8-bf10-47a8-8066-fcd5c1c51570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:09.223826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1149/2296] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:09.240640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:09.242613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:09.311196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e59d88-0763-4db9-9be4-6c14c71943b2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:09.315851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:09.316478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.316771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.317024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.328129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:09.330357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:09.343373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1148/2297] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:09.670234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298639b8-bf10-47a8-8066-fcd5c1c51570 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:09.679817 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298639b8-bf10-47a8-8066-fcd5c1c51570 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:09.685625 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a20127366e34742a0f7883f8c0e4688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa27db68c0284513a1eec07da7d5529f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:09.686263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.686548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.686822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.687478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:09.687783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:09.689417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:09.691093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:09.703594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1150/2298] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:22:09.707784 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:09.717238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d34cca-3845-41cf-8a48-2b00b72b349c service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:09.721879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a20127366e34742a0f7883f8c0e4688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa27db68c0284513a1eec07da7d5529f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:09.722525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.722806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.723076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.723708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:09.725886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:09.751343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:09.760584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1149/2299] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:09 2022] POST /identity/v3/projects => generated 354 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:09.764286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:09.776359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8effced-ecfd-4f81-ae2f-a194558440a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:09.837576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a20127366e34742a0f7883f8c0e4688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa27db68c0284513a1eec07da7d5529f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:09.838191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.839315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.839615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.840828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:09.841285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:09.843238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:09.857734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1151/2300] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:09.896732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:09.907634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2d3ce-bbdf-4529-932f-2cbf4c4f78a3 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:09.912203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a20127366e34742a0f7883f8c0e4688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa27db68c0284513a1eec07da7d5529f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:09.912835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:09.913114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:09.913384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] PATH_INFO: `/v3/projects/fbf0c04de20f4e34a4ff0af726f86ade` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:09.914546 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fbf0c04de20f4e34a4ff0af726f86ade)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:09.916457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:09.964902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf0c04de20f4e34a4ff0af726f86ade', 'request_id': 'req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:09.974427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf0c04de20f4e34a4ff0af726f86ade', 'request_id': 'req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:09.983105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf0c04de20f4e34a4ff0af726f86ade', 'request_id': 'req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:09.994814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] The token cache is being invalidate because project fbf0c04de20f4e34a4ff0af726f86ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:09.995103 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:09.997559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-8fb646d3-7f52-49ba-8a85-ebd8b6bfb8a5 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:09.997559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1150/2301] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:09 2022] DELETE /identity/v3/projects/fbf0c04de20f4e34a4ff0af726f86ade => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:10.216633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:10.218416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:10.286738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abe6e9-216b-4ad7-b96c-73dafdc3a2a6 tempest-VolumeQuotaClassesTest-1428393592 tempest-VolumeQuotaClassesTest-1428393592-project-admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:10.351323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:10.355027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:10.355255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:10.355525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] PATH_INFO: `/v3/users/9644f0f1023941e882b363a48290ca33` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:10.357288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9644f0f1023941e882b363a48290ca33)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:10.359258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:10.407847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9644f0f1023941e882b363a48290ca33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:10.410311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:10.422483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9644f0f1023941e882b363a48290ca33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:10.430218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9644f0f1023941e882b363a48290ca33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:10.438471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9644f0f1023941e882b363a48290ca33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:10.439399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9644f0f1023941e882b363a48290ca33'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:10.445671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1152/2302] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:10 2022] DELETE /identity/v3/users/9644f0f1023941e882b363a48290ca33 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:10.454461 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:10.454803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:10.455115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:10.477444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:10.478881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:10.547485 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1151/2303] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:10.557160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:10.558605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:10.618288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00e122-a810-4338-ae54-5e17e11a9ecb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:10.622589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:10.623206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:10.623483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:10.623754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:10.632963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:10.634450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:10.644779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1153/2304] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:10.934647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:10.936104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:10.948146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bc014-21d1-4756-8d34-cd9f62b2cb85 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:10.953683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:10.954417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:10.954700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:10.954972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] PATH_INFO: `/v3/projects/f73d181954a54308922fcb061b2b3d3a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:10.956119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73d181954a54308922fcb061b2b3d3a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:10.958037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:11.007250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73d181954a54308922fcb061b2b3d3a', 'request_id': 'req-eb1bac4d-990b-4ff2-99d8-708607e9b121'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.016341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73d181954a54308922fcb061b2b3d3a', 'request_id': 'req-eb1bac4d-990b-4ff2-99d8-708607e9b121'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.023277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73d181954a54308922fcb061b2b3d3a', 'request_id': 'req-eb1bac4d-990b-4ff2-99d8-708607e9b121'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.035707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] The token cache is being invalidate because project f73d181954a54308922fcb061b2b3d3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:11.036001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.036668 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.038189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1152/2305] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:10 2022] DELETE /identity/v3/projects/f73d181954a54308922fcb061b2b3d3a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:11.048364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:11.059357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62a555-51e8-4260-b0cc-7eed87ce332a service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:11.127640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:11.128209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:11.128498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:11.128768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] PATH_INFO: `/v3/users/0a20127366e34742a0f7883f8c0e4688` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:11.129942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a20127366e34742a0f7883f8c0e4688)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:11.132045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:11.188729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a20127366e34742a0f7883f8c0e4688'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.199013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:11.206951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a20127366e34742a0f7883f8c0e4688'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.218106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a20127366e34742a0f7883f8c0e4688'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.227292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a20127366e34742a0f7883f8c0e4688'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.228058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a20127366e34742a0f7883f8c0e4688'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.234868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1154/2306] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:11 2022] DELETE /identity/v3/users/0a20127366e34742a0f7883f8c0e4688 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:11.521690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:11.523147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:11.533979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:11.562442 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:11.564523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:11.628275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1bac4d-990b-4ff2-99d8-708607e9b121 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:11.654675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50685c7-7e21-4147-9bdc-e969f4f17542 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:11.659586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:11.660289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:11.660579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:11.660853 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] PATH_INFO: `/v3/projects/fa27db68c0284513a1eec07da7d5529f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:11.662067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa27db68c0284513a1eec07da7d5529f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:11.664090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:11.696693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329173cd-80f0-458d-b213-3d8fed6514cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:11.697519 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329173cd-80f0-458d-b213-3d8fed6514cd service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:11.697770 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329173cd-80f0-458d-b213-3d8fed6514cd service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:11.698048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329173cd-80f0-458d-b213-3d8fed6514cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:11.700929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-329173cd-80f0-458d-b213-3d8fed6514cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:11.713285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa27db68c0284513a1eec07da7d5529f', 'request_id': 'req-2ce3631d-9acd-48e0-8db3-f50d8289143a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.722494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa27db68c0284513a1eec07da7d5529f', 'request_id': 'req-2ce3631d-9acd-48e0-8db3-f50d8289143a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.729992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa27db68c0284513a1eec07da7d5529f', 'request_id': 'req-2ce3631d-9acd-48e0-8db3-f50d8289143a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.741664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] The token cache is being invalidate because project fa27db68c0284513a1eec07da7d5529f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:11.741960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.742685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2ce3631d-9acd-48e0-8db3-f50d8289143a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:11.744177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1155/2307] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:11 2022] DELETE /identity/v3/projects/fa27db68c0284513a1eec07da7d5529f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:11.749254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3e46-3732-4352-9be1-548ea24db2e1 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:11.749540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3e46-3732-4352-9be1-548ea24db2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:11.749828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f3e46-3732-4352-9be1-548ea24db2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:11.766736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329173cd-80f0-458d-b213-3d8fed6514cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:11.769093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329173cd-80f0-458d-b213-3d8fed6514cd service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:11.777046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-335f3e46-3732-4352-9be1-548ea24db2e1 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:11.778893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-335f3e46-3732-4352-9be1-548ea24db2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:11.780395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1153/2308] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:11.846147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1156/2309] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:11.854166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0a98-51a7-436d-9c01-3c29e2d66b11 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:11.854483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0a98-51a7-436d-9c01-3c29e2d66b11 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:11.854757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f0a98-51a7-436d-9c01-3c29e2d66b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:11.874967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-405f0a98-51a7-436d-9c01-3c29e2d66b11 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:11.876183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-405f0a98-51a7-436d-9c01-3c29e2d66b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:11.884240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1154/2310] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:11.889398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f3e46-3732-4352-9be1-548ea24db2e1 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:11.899749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f3e46-3732-4352-9be1-548ea24db2e1 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:11.905470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:11.906215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:11.906610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:11.907116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:11.907760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:11.908161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:11.909739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:11.911606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:11.926414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1157/2311] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:11.929273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0a98-51a7-436d-9c01-3c29e2d66b11 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:11.939777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f0a98-51a7-436d-9c01-3c29e2d66b11 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:11.944719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:11.945323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:11.945599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:11.945868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:11.946538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:11.948462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:11.987094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1155/2312] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:11 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:11.992961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.007053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c49e7-496d-48bf-9f8e-7baa08c2bafb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.071370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.072086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.072369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.072654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.073287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.076370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.101296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1158/2313] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:11 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:12.102816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.113966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7572edf-ad52-4fc8-9485-8e27cc36e231 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.118716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.119317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.119596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.119865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.120509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.123262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.133916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1156/2314] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:12.139745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.150392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601e40b-e909-42f8-b918-546bfbd5729a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.155361 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c8df0-1b70-4f59-a487-0323713d3002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.155965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c8df0-1b70-4f59-a487-0323713d3002 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.156242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c8df0-1b70-4f59-a487-0323713d3002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.156513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c8df0-1b70-4f59-a487-0323713d3002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.158412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c8df0-1b70-4f59-a487-0323713d3002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.163019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c8df0-1b70-4f59-a487-0323713d3002 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.171422 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1159/2315] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:12.176742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.186983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:12.193866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09306a71-09e3-49d3-8000-a04555a9e29d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.201059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.201726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.202000 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.202293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] PATH_INFO: `/v3/projects/ddce3c91f9ca40f39df38523da9c04d2/users/f45234bc55ed481f9f1f5d0792051914/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.217830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddce3c91f9ca40f39df38523da9c04d2, user_id=f45234bc55ed481f9f1f5d0792051914, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.220558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.236201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1157/2316] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:12 2022] PUT /identity/v3/projects/ddce3c91f9ca40f39df38523da9c04d2/users/f45234bc55ed481f9f1f5d0792051914/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:12.247196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc387f9-b283-4e82-9434-fb354839930a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.247797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc387f9-b283-4e82-9434-fb354839930a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.247934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc387f9-b283-4e82-9434-fb354839930a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.277047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-afc387f9-b283-4e82-9434-fb354839930a None None] MFA Rules not processed for user `f45234bc55ed481f9f1f5d0792051914`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:12.278342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-afc387f9-b283-4e82-9434-fb354839930a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:12.367478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1160/2317] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:12.372768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.438490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b53f6-7528-4023-8eb9-ce59bb3cf34d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.443239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.443844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.444124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.444398 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.445023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.446962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.474562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1158/2318] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:12 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:12.479229 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc387f9-b283-4e82-9434-fb354839930a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.490991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc387f9-b283-4e82-9434-fb354839930a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.549338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.549960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.550333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.550612 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.551266 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.553209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.562933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:12.576616 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1161/2319] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:12 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:12.580552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.591955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e067ce-230f-41ef-b73c-e75b03e52dd9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.597142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.597788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.598095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.598407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.599055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.600652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.612486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1159/2320] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:12.616803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.626995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5776f-a6c4-41f0-9488-d024cc403fd7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.631630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.632265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.632543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.632816 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] PATH_INFO: `/v3/projects/ff7a7068a3fb4a17ad7f9d865b21859b/users/cae5a49b9cd444f689e43dd41ae6dde5/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.648311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7a7068a3fb4a17ad7f9d865b21859b, user_id=cae5a49b9cd444f689e43dd41ae6dde5, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.650987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.665009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1162/2321] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:12 2022] PUT /identity/v3/projects/ff7a7068a3fb4a17ad7f9d865b21859b/users/cae5a49b9cd444f689e43dd41ae6dde5/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:12.669565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.679786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5aa7ad-764b-417e-b5d6-d6f87c2b0d72 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.737342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b015-5fd5-4b51-9a1f-c6fd056011f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.737956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b015-5fd5-4b51-9a1f-c6fd056011f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.738263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b015-5fd5-4b51-9a1f-c6fd056011f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.738536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b015-5fd5-4b51-9a1f-c6fd056011f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.739178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7b015-5fd5-4b51-9a1f-c6fd056011f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.740788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7b015-5fd5-4b51-9a1f-c6fd056011f9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.751395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1160/2322] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:12.755676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.766334 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724726b9-3ded-4074-8d89-0ded9f4c2adb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.770962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.771598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.771880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.772147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] PATH_INFO: `/v3/projects/ff7a7068a3fb4a17ad7f9d865b21859b/users/cae5a49b9cd444f689e43dd41ae6dde5/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.774042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7a7068a3fb4a17ad7f9d865b21859b, user_id=cae5a49b9cd444f689e43dd41ae6dde5, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:12.776706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:12.787418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1163/2323] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:12 2022] PUT /identity/v3/projects/ff7a7068a3fb4a17ad7f9d865b21859b/users/cae5a49b9cd444f689e43dd41ae6dde5/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:12.798356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3933b8-0b43-4336-9eef-68d96c092b8e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.798656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3933b8-0b43-4336-9eef-68d96c092b8e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.798934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3933b8-0b43-4336-9eef-68d96c092b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:12.826641 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4f3933b8-0b43-4336-9eef-68d96c092b8e None None] MFA Rules not processed for user `cae5a49b9cd444f689e43dd41ae6dde5`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:12.827851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4f3933b8-0b43-4336-9eef-68d96c092b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:12.866130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:12.899672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1161/2324] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:12.912923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:12.914949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:12.981918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfed79b-f4fa-45b3-b6ed-f839ae85eb0a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:12.986694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:12.987325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:12.987603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:12.987873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:13.051469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:13.052916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:13.063664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1164/2325] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:17.506442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3933b8-0b43-4336-9eef-68d96c092b8e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:17.525908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3933b8-0b43-4336-9eef-68d96c092b8e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:17.531544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:17.532167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:17.532445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:17.532723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:17.546472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:17.548866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:17.565092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1162/2326] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:18.996047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:18.997915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:19.010233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156862af-c3ca-496e-9571-bf058219c6b7 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:19.014286 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597399a1-1872-4aaf-a87a-69dbcfb255c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:19.014933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597399a1-1872-4aaf-a87a-69dbcfb255c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:19.015216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597399a1-1872-4aaf-a87a-69dbcfb255c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:19.015489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597399a1-1872-4aaf-a87a-69dbcfb255c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:19.017453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-597399a1-1872-4aaf-a87a-69dbcfb255c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:19.109771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597399a1-1872-4aaf-a87a-69dbcfb255c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:19.111294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597399a1-1872-4aaf-a87a-69dbcfb255c7 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:19.134423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1165/2327] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:22:22.843143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:22.919751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9818bb4-3887-49d3-8225-47ff8c7a767e service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:22.924423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:22.925230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:22.925548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:22.925859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] PATH_INFO: `/v3/users/f45234bc55ed481f9f1f5d0792051914` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:22.927197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45234bc55ed481f9f1f5d0792051914)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:22.929313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:22.988054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45234bc55ed481f9f1f5d0792051914'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.003495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45234bc55ed481f9f1f5d0792051914'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.012499 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45234bc55ed481f9f1f5d0792051914'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.013355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45234bc55ed481f9f1f5d0792051914'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.022447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45234bc55ed481f9f1f5d0792051914'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.031377 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1163/2328] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:22 2022] DELETE /identity/v3/users/f45234bc55ed481f9f1f5d0792051914 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:23.037354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:23.037952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:23.038315 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:23.047502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:23.066520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:23.070134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:23.150644 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1166/2329] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:23.163876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:23.166307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:23.223206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:23.248858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcf8f-d2ea-4c91-9e02-5359573db756 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:23.254024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:23.254731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:23.255009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:23.255287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:23.272408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:23.275328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:23.291385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1164/2330] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:23.798870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:23.801431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:23.821543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb946-37c8-4098-9e3b-605bb9624e1c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:23.829823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:23.831044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:23.831513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:23.831786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] PATH_INFO: `/v3/projects/ddce3c91f9ca40f39df38523da9c04d2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:23.833068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddce3c91f9ca40f39df38523da9c04d2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:23.835120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:23.895074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddce3c91f9ca40f39df38523da9c04d2', 'request_id': 'req-f0066c22-2238-4dbe-9ebf-af50023b4f71'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.904876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddce3c91f9ca40f39df38523da9c04d2', 'request_id': 'req-f0066c22-2238-4dbe-9ebf-af50023b4f71'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.912493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddce3c91f9ca40f39df38523da9c04d2', 'request_id': 'req-f0066c22-2238-4dbe-9ebf-af50023b4f71'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.931020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] The token cache is being invalidate because project ddce3c91f9ca40f39df38523da9c04d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:23.931514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.932609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:23.935864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1167/2331] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:23 2022] DELETE /identity/v3/projects/ddce3c91f9ca40f39df38523da9c04d2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:23.942152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:23.959898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3a6d6-a768-4d1e-a872-c45fd82ed33a service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:24.068614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:24.069782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:24.070277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:24.070767 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] PATH_INFO: `/v3/users/cae5a49b9cd444f689e43dd41ae6dde5` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:24.072966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae5a49b9cd444f689e43dd41ae6dde5)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:24.079033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:24.158587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae5a49b9cd444f689e43dd41ae6dde5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.172842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae5a49b9cd444f689e43dd41ae6dde5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.185962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae5a49b9cd444f689e43dd41ae6dde5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.186129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae5a49b9cd444f689e43dd41ae6dde5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.195031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4fa71983-a505-43f3-9e24-9b8267932d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae5a49b9cd444f689e43dd41ae6dde5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.203653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1165/2332] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:23 2022] DELETE /identity/v3/users/cae5a49b9cd444f689e43dd41ae6dde5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:24.653143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:24.655903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:24.680639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0066c22-2238-4dbe-9ebf-af50023b4f71 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:24.790483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:24.791234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:24.791592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:24.791873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] PATH_INFO: `/v3/projects/ff7a7068a3fb4a17ad7f9d865b21859b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:24.793798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7a7068a3fb4a17ad7f9d865b21859b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:24.796210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:24.862771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:24.893055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7a7068a3fb4a17ad7f9d865b21859b', 'request_id': 'req-af6927e8-cb98-4af8-b3ca-b19f86d35977'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.906417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7a7068a3fb4a17ad7f9d865b21859b', 'request_id': 'req-af6927e8-cb98-4af8-b3ca-b19f86d35977'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.916021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7a7068a3fb4a17ad7f9d865b21859b', 'request_id': 'req-af6927e8-cb98-4af8-b3ca-b19f86d35977'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.932837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] The token cache is being invalidate because project ff7a7068a3fb4a17ad7f9d865b21859b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:24.932837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.934103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-af6927e8-cb98-4af8-b3ca-b19f86d35977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:24.935336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1168/2333] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:24 2022] DELETE /identity/v3/projects/ff7a7068a3fb4a17ad7f9d865b21859b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:24.941469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36c160-1f26-499e-bd7a-1c901b28653b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:24.941799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36c160-1f26-499e-bd7a-1c901b28653b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:24.942471 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36c160-1f26-499e-bd7a-1c901b28653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:24.966138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9a36c160-1f26-499e-bd7a-1c901b28653b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:24.967506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9a36c160-1f26-499e-bd7a-1c901b28653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:25.063349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1166/2334] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:25.077051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dadea-0d85-4b2d-86c2-c91068292752 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.077466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dadea-0d85-4b2d-86c2-c91068292752 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.077867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736dadea-0d85-4b2d-86c2-c91068292752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.106826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-736dadea-0d85-4b2d-86c2-c91068292752 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:25.108102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-736dadea-0d85-4b2d-86c2-c91068292752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:25.116798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1169/2335] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:25.122834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36c160-1f26-499e-bd7a-1c901b28653b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.135315 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:25.145019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36c160-1f26-499e-bd7a-1c901b28653b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.166515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.166515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.166515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.166515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.167067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:25.167067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.167067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.182344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1167/2336] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:25.185704 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dadea-0d85-4b2d-86c2-c91068292752 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.197633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736dadea-0d85-4b2d-86c2-c91068292752 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.203920 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.204689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.205075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.205446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.206209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.208522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.251736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1170/2337] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:25 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:25.257244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.276367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2bac8-f92f-4065-b6d9-b0a0d79889c0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.383382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.384027 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.384304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.384576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.385239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.388204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.420394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1168/2338] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:25 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:25.422640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.442831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ce467-dc89-4910-b7a3-deb5323f02de admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.451089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.451726 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.452189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.452539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.453222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.455046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.467961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1171/2339] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:25.472567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.484439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348505a-d9ab-4487-bc01-720ab99d699e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.489453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b5715-3c7b-4493-a642-d6ab7d56db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.490088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5715-3c7b-4493-a642-d6ab7d56db1f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.490411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5715-3c7b-4493-a642-d6ab7d56db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.490732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5715-3c7b-4493-a642-d6ab7d56db1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.491409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b5715-3c7b-4493-a642-d6ab7d56db1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.493061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b5715-3c7b-4493-a642-d6ab7d56db1f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.506412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1169/2340] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:25.511634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.529518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac72d7b-c6e0-47e2-9932-6d3f4d142aa9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.536349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.537434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.537916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.538451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] PATH_INFO: `/v3/projects/f8ce70c030f546d9b5c936608837f155/users/ce23bdb39b794b55b7bcc0223b99ccda/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.560600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ce70c030f546d9b5c936608837f155, user_id=ce23bdb39b794b55b7bcc0223b99ccda, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.563556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.579681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1172/2341] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:25 2022] PUT /identity/v3/projects/f8ce70c030f546d9b5c936608837f155/users/ce23bdb39b794b55b7bcc0223b99ccda/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:25.600500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.601099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.602631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.650309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] MFA Rules not processed for user `ce23bdb39b794b55b7bcc0223b99ccda`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:25.652981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:25.737688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1170/2342] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:25.751166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:25.753655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:25.829601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e90b4d-561c-43ec-8b7c-460ff112c939 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:25.834157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d1a9a-84aa-4a9f-9785-f4aafa22385d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '916a9bae3ca94918af4efdfcae19d928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:25.834982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1a9a-84aa-4a9f-9785-f4aafa22385d service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:25.835372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1a9a-84aa-4a9f-9785-f4aafa22385d service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:25.836155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d1a9a-84aa-4a9f-9785-f4aafa22385d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:25.848225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d1a9a-84aa-4a9f-9785-f4aafa22385d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:25.850154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d1a9a-84aa-4a9f-9785-f4aafa22385d service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:25.862814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1173/2343] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:32.411381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:32.412890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:32.492987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bde2d4-17d6-48ee-bee7-f8573e3454ad None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:32.497213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e163b-c667-41b8-8e37-41c62c3ec67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:32.497848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e163b-c667-41b8-8e37-41c62c3ec67b service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:32.498130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e163b-c667-41b8-8e37-41c62c3ec67b service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:32.498445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e163b-c667-41b8-8e37-41c62c3ec67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:32.500496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-712e163b-c667-41b8-8e37-41c62c3ec67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:32.512748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:32.604032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e163b-c667-41b8-8e37-41c62c3ec67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:32.607373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e163b-c667-41b8-8e37-41c62c3ec67b service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:32.625805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1171/2344] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:33.517465 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74454c-b12e-4138-a993-bab7cb91bee6 None None] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.518144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74454c-b12e-4138-a993-bab7cb91bee6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.518144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74454c-b12e-4138-a993-bab7cb91bee6 None None] PATH_INFO: `/` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.519530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1174/2345] 10.222.0.36 () {54 vars in 921 bytes} [Thu Sep 1 08:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 08:22:33.550941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.551798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.551903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.600265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] MFA Rules not processed for user `6b056c355c8b4959b5808cc22304e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:33.602657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:33.712532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1172/2346] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Sep 1 08:22:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:33.725804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74454c-b12e-4138-a993-bab7cb91bee6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:33.729447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7d74454c-b12e-4138-a993-bab7cb91bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:33.748815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74454c-b12e-4138-a993-bab7cb91bee6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:33.753964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:33.754812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:33.755094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:33.755365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:33.765397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:33.767047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:33.784618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1175/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:34.255556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:34.258050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:34.279831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564b7d2-372a-41dd-920e-830aba95b7d5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:34.284746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:34.285401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:34.285684 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:34.285961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] PATH_INFO: `/v3/users/ae7ef8caee764706b20b5460c10a12f1` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:34.287148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7ef8caee764706b20b5460c10a12f1)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:34.289089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:34.354006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7ef8caee764706b20b5460c10a12f1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.369182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7ef8caee764706b20b5460c10a12f1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.377676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7ef8caee764706b20b5460c10a12f1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.378477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7ef8caee764706b20b5460c10a12f1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.389092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7ef8caee764706b20b5460c10a12f1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.399737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1173/2348] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:34 2022] DELETE /identity/v3/users/ae7ef8caee764706b20b5460c10a12f1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:34.634581 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:34.646605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab609acb-6523-4a73-a708-c186aa0be428 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:34.689838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:34.711520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:34.712181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:34.712460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:34.712734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] PATH_INFO: `/v3/projects/0caf9b039b634259bace8ccc66fbcec8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:34.713858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0caf9b039b634259bace8ccc66fbcec8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:34.716060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:34.763516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0caf9b039b634259bace8ccc66fbcec8', 'request_id': 'req-61b3c97a-a2d3-4103-8716-88b6889db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.772559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0caf9b039b634259bace8ccc66fbcec8', 'request_id': 'req-61b3c97a-a2d3-4103-8716-88b6889db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.781293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0caf9b039b634259bace8ccc66fbcec8', 'request_id': 'req-61b3c97a-a2d3-4103-8716-88b6889db781'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.792648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] The token cache is being invalidate because project 0caf9b039b634259bace8ccc66fbcec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:34.792991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.793882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.798710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1176/2349] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:34 2022] DELETE /identity/v3/projects/0caf9b039b634259bace8ccc66fbcec8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:34.799687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:34.801197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:34.816030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27f601-d4b8-4104-8efe-e62a1aa78d20 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:34.829454 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:34.888255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:34.888896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:34.889168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:34.889440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] PATH_INFO: `/v3/users/e2663d29cc1b436e98a60794a2b6b82b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:34.890611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2663d29cc1b436e98a60794a2b6b82b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:34.892535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:34.944277 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2663d29cc1b436e98a60794a2b6b82b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.958627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2663d29cc1b436e98a60794a2b6b82b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.967989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2663d29cc1b436e98a60794a2b6b82b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.968756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2663d29cc1b436e98a60794a2b6b82b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.979226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0232a69a-eb10-4bd9-b83e-663a8be9cad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2663d29cc1b436e98a60794a2b6b82b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:34.993051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1174/2350] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:34 2022] DELETE /identity/v3/users/e2663d29cc1b436e98a60794a2b6b82b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:35.190915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:35.193342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:35.211418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3c97a-a2d3-4103-8716-88b6889db781 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:35.272165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:35.272502 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.272779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.273054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] PATH_INFO: `/v3/projects/b76162fed119410b8c12f712f527199b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.274200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76162fed119410b8c12f712f527199b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:35.276226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:35.327480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76162fed119410b8c12f712f527199b', 'request_id': 'req-e735f693-3df3-484f-90fd-df7a5b8b85ed'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:35.335233 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76162fed119410b8c12f712f527199b', 'request_id': 'req-e735f693-3df3-484f-90fd-df7a5b8b85ed'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:35.342731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76162fed119410b8c12f712f527199b', 'request_id': 'req-e735f693-3df3-484f-90fd-df7a5b8b85ed'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:35.358850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] The token cache is being invalidate because project b76162fed119410b8c12f712f527199b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:35.359140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:35.359796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e735f693-3df3-484f-90fd-df7a5b8b85ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:35.361310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1177/2351] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:35 2022] DELETE /identity/v3/projects/b76162fed119410b8c12f712f527199b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:22:35.367281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1af5e-4ae6-4fff-bcc9-f634102d0d48 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.367558 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1af5e-4ae6-4fff-bcc9-f634102d0d48 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.367835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1af5e-4ae6-4fff-bcc9-f634102d0d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.390093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-08d1af5e-4ae6-4fff-bcc9-f634102d0d48 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:35.391348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-08d1af5e-4ae6-4fff-bcc9-f634102d0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:35.458251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1175/2352] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:35.467857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796c14-eff8-45d1-ae22-2eb34be52e53 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.468180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796c14-eff8-45d1-ae22-2eb34be52e53 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.468622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796c14-eff8-45d1-ae22-2eb34be52e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.479640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:35.494857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c4796c14-eff8-45d1-ae22-2eb34be52e53 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:35.496128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c4796c14-eff8-45d1-ae22-2eb34be52e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:35.505230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1178/2353] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:22:35.509785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1af5e-4ae6-4fff-bcc9-f634102d0d48 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:35.519687 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1af5e-4ae6-4fff-bcc9-f634102d0d48 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:35.524421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:35.524955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.525234 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.525498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.526147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:35.526464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:35.528590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:35.540312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1176/2354] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:22:35.545844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796c14-eff8-45d1-ae22-2eb34be52e53 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:35.556360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796c14-eff8-45d1-ae22-2eb34be52e53 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:35.562393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:35.563010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.563283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.563548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.564199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:35.566375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:35.608753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1179/2355] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:35 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:35.613734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:35.624649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57745ed3-4023-42ba-a4c1-b307e55dc42c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:35.645411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:35.695824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:35.696896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.697382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.697872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.699655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:35.703549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:35.733437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1177/2356] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:35 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:35.737950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:35.751708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8586d-9839-4458-974b-9fde491b09a0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:35.757050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:35.757670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.758020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.758210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.758911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:35.760565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:35.772260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1180/2357] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:35.778986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:35.799897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ca57-9cd9-4d59-8122-ecea394cbff0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:35.805407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85ed52-2dd6-4b98-b146-e176bb7db82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:35.806035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ed52-2dd6-4b98-b146-e176bb7db82f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.806359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ed52-2dd6-4b98-b146-e176bb7db82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.806636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85ed52-2dd6-4b98-b146-e176bb7db82f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.807289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85ed52-2dd6-4b98-b146-e176bb7db82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:35.809536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85ed52-2dd6-4b98-b146-e176bb7db82f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:35.822420 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1178/2358] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:35.828402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:35.839326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69101010-fffc-4942-aae7-6fd82c56bd1b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:35.847696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:35.849890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.850399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.850903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] PATH_INFO: `/v3/projects/0f970702055c41599acbfb0db92b8bd7/users/6b0f514af01648babba6916e6fb55d14/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.881323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f970702055c41599acbfb0db92b8bd7, user_id=6b0f514af01648babba6916e6fb55d14, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:35.884368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:35.900100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1181/2359] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:35 2022] PUT /identity/v3/projects/0f970702055c41599acbfb0db92b8bd7/users/6b0f514af01648babba6916e6fb55d14/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:35.913366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838637d-822d-4d11-a570-54aa76bf24f2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:35.913654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838637d-822d-4d11-a570-54aa76bf24f2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:35.913929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838637d-822d-4d11-a570-54aa76bf24f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:35.945444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b838637d-822d-4d11-a570-54aa76bf24f2 None None] MFA Rules not processed for user `6b0f514af01648babba6916e6fb55d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:35.947029 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b838637d-822d-4d11-a570-54aa76bf24f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:36.028604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1179/2360] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:36.039892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:36.041620 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:36.124256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4158d1e-6bc8-4aee-befd-694b02f31a09 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:36.129154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2dbf8-d4f5-488b-a9a5-f422e2dda4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:36.129852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dbf8-d4f5-488b-a9a5-f422e2dda4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:36.130215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dbf8-d4f5-488b-a9a5-f422e2dda4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:36.130593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2dbf8-d4f5-488b-a9a5-f422e2dda4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:36.140065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2dbf8-d4f5-488b-a9a5-f422e2dda4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:36.141596 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2dbf8-d4f5-488b-a9a5-f422e2dda4e6 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:36.154711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1182/2361] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:38.750488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838637d-822d-4d11-a570-54aa76bf24f2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:38.815868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838637d-822d-4d11-a570-54aa76bf24f2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:38.820404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:38.821026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:38.821304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:38.821579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] PATH_INFO: `/v3/users/6b0f514af01648babba6916e6fb55d14` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:38.823024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0f514af01648babba6916e6fb55d14)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:38.826874 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:38.862266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:38.875623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0f514af01648babba6916e6fb55d14'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:38.888328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0f514af01648babba6916e6fb55d14'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:38.895261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0f514af01648babba6916e6fb55d14'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:38.896005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0f514af01648babba6916e6fb55d14'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:38.904791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0f514af01648babba6916e6fb55d14'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:38.911068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1180/2362] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:38 2022] DELETE /identity/v3/users/6b0f514af01648babba6916e6fb55d14 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:38.915647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:38.916121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:38.916210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:38.935570 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:38.936796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:38.997313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1183/2363] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:39.007214 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:39.008601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:39.069224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de37a-e280-4e94-bc6b-63a154c635f8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:39.073150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:39.073774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:39.074633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:39.075120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:39.085501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:39.086996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:39.098849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1181/2364] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:39.421824 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:39.423448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:39.443537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5606cf-97c4-4e3a-a75e-099326f77aeb None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:39.451763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:39.452537 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:39.452888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:39.453285 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] PATH_INFO: `/v3/projects/0f970702055c41599acbfb0db92b8bd7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:39.454618 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f970702055c41599acbfb0db92b8bd7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:39.456797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:39.511687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:39.522794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f970702055c41599acbfb0db92b8bd7', 'request_id': 'req-6f35aa19-5a63-4c41-9b8d-b4424effcb35'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:39.530905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f970702055c41599acbfb0db92b8bd7', 'request_id': 'req-6f35aa19-5a63-4c41-9b8d-b4424effcb35'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:39.537911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f970702055c41599acbfb0db92b8bd7', 'request_id': 'req-6f35aa19-5a63-4c41-9b8d-b4424effcb35'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:39.550316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] The token cache is being invalidate because project 0f970702055c41599acbfb0db92b8bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:39.550681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:39.551456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-6f35aa19-5a63-4c41-9b8d-b4424effcb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:39.553082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1184/2365] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:39 2022] DELETE /identity/v3/projects/0f970702055c41599acbfb0db92b8bd7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:49.094463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=43,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:49.253954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:49.255426 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:49.271068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd68f1c-6f39-4a8a-a127-fdc8881465a2 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:49.336698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:49.337108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:49.337387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:49.338160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] PATH_INFO: `/v3/users/ce23bdb39b794b55b7bcc0223b99ccda` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:49.338914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce23bdb39b794b55b7bcc0223b99ccda)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:49.341981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:49.393491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce23bdb39b794b55b7bcc0223b99ccda'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:49.406902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce23bdb39b794b55b7bcc0223b99ccda'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:49.414120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce23bdb39b794b55b7bcc0223b99ccda'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:49.414940 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce23bdb39b794b55b7bcc0223b99ccda'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:49.424547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce23bdb39b794b55b7bcc0223b99ccda'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:49.437827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1182/2366] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:22:49 2022] DELETE /identity/v3/users/ce23bdb39b794b55b7bcc0223b99ccda => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:49.439745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:49.440324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:49.440441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:49.461255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:49.462543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:49.557347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1185/2367] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:49.566987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:49.568390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:49.636254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb7ba-daae-485c-8d4c-68680a370fcc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:49.640218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffc00a-762c-40e9-a193-cfbbb0932630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:49.640851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc00a-762c-40e9-a193-cfbbb0932630 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:49.641135 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc00a-762c-40e9-a193-cfbbb0932630 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:49.641406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffc00a-762c-40e9-a193-cfbbb0932630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:49.652295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffc00a-762c-40e9-a193-cfbbb0932630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:49.653666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ffc00a-762c-40e9-a193-cfbbb0932630 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:49.664153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1183/2368] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:22:49.952752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:49.954257 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:49.967662 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13820c2-81f1-4fbe-ad93-50c5532b08b3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:49.972333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:49.972975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:49.974191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:49.974524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] PATH_INFO: `/v3/projects/f8ce70c030f546d9b5c936608837f155` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:49.976049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ce70c030f546d9b5c936608837f155)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:49.978253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.035474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ce70c030f546d9b5c936608837f155', 'request_id': 'req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:50.042075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ce70c030f546d9b5c936608837f155', 'request_id': 'req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:50.049260 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ce70c030f546d9b5c936608837f155', 'request_id': 'req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:50.060178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] The token cache is being invalidate because project f8ce70c030f546d9b5c936608837f155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:22:50.060488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:50.061108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3798662b-f3d8-46ea-9f6d-e2d97cfc9be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:22:50.062978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1186/2369] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:22:49 2022] DELETE /identity/v3/projects/f8ce70c030f546d9b5c936608837f155 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:50.067891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276555d-c524-470e-b27e-2953c1547cf6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.068178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276555d-c524-470e-b27e-2953c1547cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.068446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276555d-c524-470e-b27e-2953c1547cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.087717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4276555d-c524-470e-b27e-2953c1547cf6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:50.088900 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4276555d-c524-470e-b27e-2953c1547cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:50.106230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:50.150404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1184/2370] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:50.159201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d645-d1ca-4550-bc1f-84917ae363d4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.159420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d645-d1ca-4550-bc1f-84917ae363d4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.159694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9d645-d1ca-4550-bc1f-84917ae363d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.181446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6ec9d645-d1ca-4550-bc1f-84917ae363d4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:50.182691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6ec9d645-d1ca-4550-bc1f-84917ae363d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:50.191484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1187/2371] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:50.195826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276555d-c524-470e-b27e-2953c1547cf6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:50.205968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276555d-c524-470e-b27e-2953c1547cf6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:50.210729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:50.211344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.211620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.211891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.212592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:22:50.212888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:50.214547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.227913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1185/2372] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:22:50.233808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d645-d1ca-4550-bc1f-84917ae363d4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:50.243355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9d645-d1ca-4550-bc1f-84917ae363d4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:50.248960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:50.249573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.249883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.250160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.251386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:50.252782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.287727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1188/2373] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:22:50 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:22:50.292197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:50.303060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718000b1-178b-4c11-9a5a-9675bdc0ce05 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:50.373569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:50.374288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.374718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.375096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.375734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:50.378113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.403005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1186/2374] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:22:50 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:22:50.406927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:50.418730 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f36d6-dbf6-40de-9913-2b0b3017efab admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:50.436052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:50.436899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.437377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.437727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.438524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:50.440283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.454089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1189/2375] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:50.456811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:50.467462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8e5ad-0d43-4ff6-b64e-8e811241cadf admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:50.472202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570955d-b8ac-49a7-bee3-f5450a029225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:50.472806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570955d-b8ac-49a7-bee3-f5450a029225 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.473080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570955d-b8ac-49a7-bee3-f5450a029225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.473347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570955d-b8ac-49a7-bee3-f5450a029225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.474013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570955d-b8ac-49a7-bee3-f5450a029225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:50.475688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570955d-b8ac-49a7-bee3-f5450a029225 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.489523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1187/2376] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:22:50.493857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:50.505058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262f922-4cb0-44da-b3db-1c43dfbfadf4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:50.509892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:50.511711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.511711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.511711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] PATH_INFO: `/v3/projects/7ebe67626e8e42a1bdde17ceca146aac/users/598f95b0bacc47b4beba2e37527dc308/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.515410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:22:50.530490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebe67626e8e42a1bdde17ceca146aac, user_id=598f95b0bacc47b4beba2e37527dc308, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:50.533176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.547693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1190/2377] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:22:50 2022] PUT /identity/v3/projects/7ebe67626e8e42a1bdde17ceca146aac/users/598f95b0bacc47b4beba2e37527dc308/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:22:50.619836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120bfc6-3e10-4f1d-8523-6510947d84cd None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.620089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120bfc6-3e10-4f1d-8523-6510947d84cd None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.620455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120bfc6-3e10-4f1d-8523-6510947d84cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.654917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4120bfc6-3e10-4f1d-8523-6510947d84cd None None] MFA Rules not processed for user `598f95b0bacc47b4beba2e37527dc308`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:22:50.656137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4120bfc6-3e10-4f1d-8523-6510947d84cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:50.726714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1188/2378] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:22:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:22:50.739083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:22:50.740849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:22:50.801358 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e595-e37a-4501-978c-306cf80df1be admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:22:50.805050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5590e1-93da-45a9-bb6b-bb65e7cf1e6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '916a9bae3ca94918af4efdfcae19d928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:22:50.805648 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5590e1-93da-45a9-bb6b-bb65e7cf1e6e service glance] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:22:50.805924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5590e1-93da-45a9-bb6b-bb65e7cf1e6e service glance] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:22:50.806196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5590e1-93da-45a9-bb6b-bb65e7cf1e6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:22:50.814768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5590e1-93da-45a9-bb6b-bb65e7cf1e6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:22:50.816186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5590e1-93da-45a9-bb6b-bb65e7cf1e6e service glance] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:22:50.825463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1191/2379] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:22:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:00.723699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:00.821003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:11.632023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120bfc6-3e10-4f1d-8523-6510947d84cd None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:11.705642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120bfc6-3e10-4f1d-8523-6510947d84cd None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:11.710441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:11.711083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:11.711363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:11.711639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] PATH_INFO: `/v3/users/598f95b0bacc47b4beba2e37527dc308` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:11.714405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=598f95b0bacc47b4beba2e37527dc308)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:11.716375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:11.787467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598f95b0bacc47b4beba2e37527dc308'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:11.811283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598f95b0bacc47b4beba2e37527dc308'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:11.819863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598f95b0bacc47b4beba2e37527dc308'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:11.820611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598f95b0bacc47b4beba2e37527dc308'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:11.829349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598f95b0bacc47b4beba2e37527dc308'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:11.835688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1189/2380] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:11 2022] DELETE /identity/v3/users/598f95b0bacc47b4beba2e37527dc308 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:11.840399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:11.840910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:11.841016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:11.863416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:11.864646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:11.942309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1192/2381] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:11.952508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:11.958479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:12.035358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf19b70-8c8b-430e-8263-d544dd08e7bb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.039713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d6e73-8d0b-465e-89b8-3d98959ea393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.040621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d6e73-8d0b-465e-89b8-3d98959ea393 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.040902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d6e73-8d0b-465e-89b8-3d98959ea393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.041173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d6e73-8d0b-465e-89b8-3d98959ea393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.052261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d6e73-8d0b-465e-89b8-3d98959ea393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.053710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d6e73-8d0b-465e-89b8-3d98959ea393 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.064583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1190/2382] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:23:12.342043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:12.343527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:12.359497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989f20-1936-40a9-85ef-4e5c53ac8055 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.364955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.365603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.365884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.366160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] PATH_INFO: `/v3/projects/7ebe67626e8e42a1bdde17ceca146aac` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.367486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebe67626e8e42a1bdde17ceca146aac)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.369417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.419781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebe67626e8e42a1bdde17ceca146aac', 'request_id': 'req-75904bdb-4037-4d02-badc-fae9ac2dfdcf'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:12.427287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebe67626e8e42a1bdde17ceca146aac', 'request_id': 'req-75904bdb-4037-4d02-badc-fae9ac2dfdcf'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:12.433688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebe67626e8e42a1bdde17ceca146aac', 'request_id': 'req-75904bdb-4037-4d02-badc-fae9ac2dfdcf'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:12.444489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] The token cache is being invalidate because project 7ebe67626e8e42a1bdde17ceca146aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:12.444780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:12.445424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-75904bdb-4037-4d02-badc-fae9ac2dfdcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:12.446954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1193/2383] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:12 2022] DELETE /identity/v3/projects/7ebe67626e8e42a1bdde17ceca146aac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:23:12.451696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf594-1333-417f-b7b3-340a800dd49a None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.451974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf594-1333-417f-b7b3-340a800dd49a None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.452254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edf594-1333-417f-b7b3-340a800dd49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.474572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b3edf594-1333-417f-b7b3-340a800dd49a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:12.475810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b3edf594-1333-417f-b7b3-340a800dd49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:12.494529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:12.539357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1191/2384] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:12.546942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e398ba-b0a1-44a9-857d-2d9ab3473921 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.547400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e398ba-b0a1-44a9-857d-2d9ab3473921 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.547855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e398ba-b0a1-44a9-857d-2d9ab3473921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.567461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c5e398ba-b0a1-44a9-857d-2d9ab3473921 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:12.568657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c5e398ba-b0a1-44a9-857d-2d9ab3473921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:12.576419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1194/2385] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:12.581125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf594-1333-417f-b7b3-340a800dd49a None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:12.591626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edf594-1333-417f-b7b3-340a800dd49a None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.596997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.597611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.597890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.598165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.598852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:23:12.599155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.600758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.612888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1192/2386] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:23:12.617363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e398ba-b0a1-44a9-857d-2d9ab3473921 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:12.626576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e398ba-b0a1-44a9-857d-2d9ab3473921 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.632145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.632732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.633009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.633278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.633904 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.635847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.663108 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1195/2387] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:12 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:12.667352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:12.677658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d388-4b35-4b5c-b521-52728cec4ecc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.737644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.738181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.738563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.738840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.739482 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.741477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.769212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1193/2388] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:12 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:23:12.770473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:12.781095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50898fd4-9cdc-44dc-bec7-8b7037da0e0e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.787035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.787857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.788139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.788414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.789073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.790739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.802169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1196/2389] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:12.806905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:12.818476 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574865ca-3235-4906-b091-37b656a387d8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.823292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59c81c-0bc5-4772-99fa-b6e708e5ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.823911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59c81c-0bc5-4772-99fa-b6e708e5ced9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.824193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59c81c-0bc5-4772-99fa-b6e708e5ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.824469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59c81c-0bc5-4772-99fa-b6e708e5ced9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.825122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59c81c-0bc5-4772-99fa-b6e708e5ced9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.826811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59c81c-0bc5-4772-99fa-b6e708e5ced9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.839727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1194/2390] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:12.843977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:12.855869 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33908939-adcd-475f-a0f7-a89412321d09 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:12.866757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:12.867434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.867815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.868090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] PATH_INFO: `/v3/projects/809efa68c0f4428aa1d254bc9c11a7f0/users/6d19ca422fb84f2abf3e46128aa76cea/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.885044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809efa68c0f4428aa1d254bc9c11a7f0, user_id=6d19ca422fb84f2abf3e46128aa76cea, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:12.888118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:12.903373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1197/2391] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:12 2022] PUT /identity/v3/projects/809efa68c0f4428aa1d254bc9c11a7f0/users/6d19ca422fb84f2abf3e46128aa76cea/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:12.915402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44176c-ec3a-47a2-9c96-f928fa81f447 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:12.915691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44176c-ec3a-47a2-9c96-f928fa81f447 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:12.915965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44176c-ec3a-47a2-9c96-f928fa81f447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:12.944844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9a44176c-ec3a-47a2-9c96-f928fa81f447 None None] MFA Rules not processed for user `6d19ca422fb84f2abf3e46128aa76cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:12.946054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9a44176c-ec3a-47a2-9c96-f928fa81f447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:13.020644 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1195/2392] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:13.031741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:13.034385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:13.058523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:13.117550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2352-b22c-4a9c-b3b8-83755bf6a776 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:13.117550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:13.117550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:13.117550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:13.117943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:13.121913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:13.123395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:13.134482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1198/2393] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:15.637233 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb02316-2069-4609-acc5-ae43816b04e7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.637707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb02316-2069-4609-acc5-ae43816b04e7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.637800 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb02316-2069-4609-acc5-ae43816b04e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.658937 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3cb02316-2069-4609-acc5-ae43816b04e7 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:15.660542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3cb02316-2069-4609-acc5-ae43816b04e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:15.673095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:15.720566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1196/2394] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:23:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:15.770741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:15.772243 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:15.844295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5745e-569e-40cc-b092-b30e7ece7345 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:15.850776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:15.851736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:15.852020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:15.852365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:15.863034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:15.864664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:15.873655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1199/2395] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:23:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:23:16.577151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f47f-1806-4923-ba06-c872bfacb942 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.577517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f47f-1806-4923-ba06-c872bfacb942 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.577893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f47f-1806-4923-ba06-c872bfacb942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.610872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-03c2f47f-1806-4923-ba06-c872bfacb942 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:16.614299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-03c2f47f-1806-4923-ba06-c872bfacb942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:16.624136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1197/2396] 10.222.0.36 () {58 vars in 967 bytes} [Thu Sep 1 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:16.643125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:16.651527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abeca39-c4ee-4fa2-b620-cd41f0fd5c5d service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:16.659157 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:16.660016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.660311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.660583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.671204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:16.672948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:16.683121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1200/2397] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 08:23:16.943454 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145a62-3c49-44f8-ad50-9bb6ba0c0604 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:16.943917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145a62-3c49-44f8-ad50-9bb6ba0c0604 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:16.944008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea145a62-3c49-44f8-ad50-9bb6ba0c0604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:16.963831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ea145a62-3c49-44f8-ad50-9bb6ba0c0604 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:16.965068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ea145a62-3c49-44f8-ad50-9bb6ba0c0604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:16.972978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1198/2398] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:23:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:16.985589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:16.996958 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7781809d-6477-4fd4-baa6-d809ed013615 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:17.001987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:17.002753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:17.003067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:17.003299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:17.011776 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:17.013371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:17.022409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1201/2399] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:23:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:23:17.384865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:17.385149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:17.385422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:17.405128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:17.406385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:17.414778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1199/2400] 10.222.0.36 () {58 vars in 967 bytes} [Thu Sep 1 08:23:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:17.430045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:17.447573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d302b-3e17-48df-9e3a-9b292a58a24c service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:17.453231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98079a2a-a412-4912-a13c-6834e0c09cb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:17.453680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079a2a-a412-4912-a13c-6834e0c09cb0 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:17.453963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079a2a-a412-4912-a13c-6834e0c09cb0 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:17.454270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98079a2a-a412-4912-a13c-6834e0c09cb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:17.464350 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98079a2a-a412-4912-a13c-6834e0c09cb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:17.465926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98079a2a-a412-4912-a13c-6834e0c09cb0 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:17.474310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1202/2401] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:23:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:23:19.799337 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:19.802497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:19.903516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c3ccb-af0f-4cb2-978b-9010f3872577 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:19.908395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:19.909289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:19.909738 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:19.910857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] PATH_INFO: `/v3/users/b9388b6b0c0148988890e5c877f12825` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:19.912250 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9388b6b0c0148988890e5c877f12825)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:19.914667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:19.998433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9388b6b0c0148988890e5c877f12825'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.018992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9388b6b0c0148988890e5c877f12825'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.030122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9388b6b0c0148988890e5c877f12825'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.031093 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9388b6b0c0148988890e5c877f12825'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.043422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9388b6b0c0148988890e5c877f12825'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.053261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1200/2402] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:19 2022] DELETE /identity/v3/users/b9388b6b0c0148988890e5c877f12825 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:20.059615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.060885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.061498 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.102819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:20.104182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:20.175254 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1203/2403] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:20.192741 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:20.194308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:20.232261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:20.276339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f2db-a249-4962-93a9-ed56a07940b9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:20.281657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3094342-97eb-40b2-b7af-7651b53c2cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:20.282821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094342-97eb-40b2-b7af-7651b53c2cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.284335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094342-97eb-40b2-b7af-7651b53c2cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.284508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3094342-97eb-40b2-b7af-7651b53c2cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.297924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3094342-97eb-40b2-b7af-7651b53c2cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:20.300263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3094342-97eb-40b2-b7af-7651b53c2cf9 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:20.310755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1201/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:20.641999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:20.644206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:20.665333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c24c8-cbdd-4223-aa13-caba39851e7d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:20.675701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:20.676449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.678001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.678001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] PATH_INFO: `/v3/projects/9f0017ecddbc4c988687d7dbee74787d` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.681329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0017ecddbc4c988687d7dbee74787d)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:20.685695 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:20.698145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:20.752436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0017ecddbc4c988687d7dbee74787d', 'request_id': 'req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.761342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0017ecddbc4c988687d7dbee74787d', 'request_id': 'req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.770230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0017ecddbc4c988687d7dbee74787d', 'request_id': 'req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.781206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] The token cache is being invalidate because project 9f0017ecddbc4c988687d7dbee74787d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:20.781491 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.782159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1ac1ebb2-8b6b-4500-829f-6d36d3513dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:20.784010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1204/2405] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:20 2022] DELETE /identity/v3/projects/9f0017ecddbc4c988687d7dbee74787d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:23:20.788935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e1e7-67eb-4f67-8350-01e623a024b7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.789223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e1e7-67eb-4f67-8350-01e623a024b7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.789500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897e1e7-67eb-4f67-8350-01e623a024b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.810061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8897e1e7-67eb-4f67-8350-01e623a024b7 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:20.811223 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8897e1e7-67eb-4f67-8350-01e623a024b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:20.873249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1202/2406] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:20.888343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c31ee-021c-479a-a042-8c453927fc3f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.888628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c31ee-021c-479a-a042-8c453927fc3f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.888907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c31ee-021c-479a-a042-8c453927fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.910977 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3b2c31ee-021c-479a-a042-8c453927fc3f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:20.912213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3b2c31ee-021c-479a-a042-8c453927fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:20.920786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1205/2407] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:20.926443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e1e7-67eb-4f67-8350-01e623a024b7 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:20.936745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897e1e7-67eb-4f67-8350-01e623a024b7 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:20.942599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:20.943289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.943576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.943852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.944530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:23:20.944968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:20.946817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:20.961148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1203/2408] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:23:20.965603 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c31ee-021c-479a-a042-8c453927fc3f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:20.976780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c31ee-021c-479a-a042-8c453927fc3f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:20.981693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:20.982430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:20.982780 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:20.983064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:20.983727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:20.985657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.033638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1206/2409] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:23:20 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:23:21.041316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.053501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d545b75-34a4-4c7b-90fe-a1ae5e9c0b5b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.125574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.126190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.128059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.128350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.129048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.131156 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.158886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1204/2410] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:23:21.160343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.172096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2377a6-180e-46be-a5f3-b1e452acb8d2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.179139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.180096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.180490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.180862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.181813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.184190 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.201837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1207/2411] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:23:21.203970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.217001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527bf1d-f290-4558-9885-b088fe833710 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.223052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff431f5-77eb-4afe-8d60-d5e55e0c83dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.223675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff431f5-77eb-4afe-8d60-d5e55e0c83dd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.223956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff431f5-77eb-4afe-8d60-d5e55e0c83dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.224225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff431f5-77eb-4afe-8d60-d5e55e0c83dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.224894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff431f5-77eb-4afe-8d60-d5e55e0c83dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.226840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff431f5-77eb-4afe-8d60-d5e55e0c83dd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.239961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1205/2412] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:23:21.248146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.266936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e0046-e693-467e-9a9e-59feacbe3519 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.272239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.272901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.273177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.273452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] PATH_INFO: `/v3/projects/da9b0c43d715429c963f0372d2ad9fdf/users/ba00229e9fd24a4e89c1aacdf47a1e2f/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.290534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9b0c43d715429c963f0372d2ad9fdf, user_id=ba00229e9fd24a4e89c1aacdf47a1e2f, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.293301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.309208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1208/2413] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:23:21 2022] PUT /identity/v3/projects/da9b0c43d715429c963f0372d2ad9fdf/users/ba00229e9fd24a4e89c1aacdf47a1e2f/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:21.315525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0866e-3e89-4bd2-82a2-196660f6d9f7 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.315805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0866e-3e89-4bd2-82a2-196660f6d9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.316080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0866e-3e89-4bd2-82a2-196660f6d9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.337358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bca0866e-3e89-4bd2-82a2-196660f6d9f7 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:21.338670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bca0866e-3e89-4bd2-82a2-196660f6d9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:21.382460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:21.414074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1206/2414] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:21.424927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:21.426743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:21.495039 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c072-f522-4bf3-a0b4-1e1095a47dca admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:21.498762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:21.499373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:21.499655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:21.499930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:21.510005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:21.511486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:21.521377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1209/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:22.303313 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:22.304183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:22.304183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:22.343585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] MFA Rules not processed for user `ba00229e9fd24a4e89c1aacdf47a1e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:22.344976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:22.483146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1207/2416] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:22.495405 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:22.497011 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:22.575499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:22.617597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c935d02-7440-4cd6-bed2-1de286cd10a6 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:22.622184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cebecb-9bc7-4a2a-a89c-e97768478541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:22.623201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebecb-9bc7-4a2a-a89c-e97768478541 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:22.623201 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebecb-9bc7-4a2a-a89c-e97768478541 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:22.623441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cebecb-9bc7-4a2a-a89c-e97768478541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:22.633664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cebecb-9bc7-4a2a-a89c-e97768478541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:22.635167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cebecb-9bc7-4a2a-a89c-e97768478541 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:22.648933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1210/2417] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:23.501709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:23.503781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:23.517511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a0fee-064a-4452-93c5-5f79b03daca5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:23.522035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:23.522683 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:23.522958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:23.523226 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] PATH_INFO: `/v3/users/6d19ca422fb84f2abf3e46128aa76cea` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:23.524325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d19ca422fb84f2abf3e46128aa76cea)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:23.526219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:23.575366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d19ca422fb84f2abf3e46128aa76cea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:23.589820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d19ca422fb84f2abf3e46128aa76cea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:23.601274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d19ca422fb84f2abf3e46128aa76cea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:23.602065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d19ca422fb84f2abf3e46128aa76cea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:23.613273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d19ca422fb84f2abf3e46128aa76cea'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:23.620203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1208/2418] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:23:23 2022] DELETE /identity/v3/users/6d19ca422fb84f2abf3e46128aa76cea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:23:23.625102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b6b3-4f7d-42e7-88f2-948bd329c2b4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:23.625659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b6b3-4f7d-42e7-88f2-948bd329c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:23.625659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1b6b3-4f7d-42e7-88f2-948bd329c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:23.652754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-05c1b6b3-4f7d-42e7-88f2-948bd329c2b4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:23.654020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-05c1b6b3-4f7d-42e7-88f2-948bd329c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:23.720572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1211/2419] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:23:23.730700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:23.732062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:23.767671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:23.790845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ec695-80ae-4389-aac0-5c94d1f7c07b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:23.794849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:23.795456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:23.795732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:23.796004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:23.806120 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:23.807577 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:23.817772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1209/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:23:24.129796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:24.130168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:24.130485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:24.136678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:23:24.138530 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:24.151540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] MFA Rules not processed for user `ba00229e9fd24a4e89c1aacdf47a1e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:23:24.152786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:23:24.157200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb0823-5ead-4729-b476-8708d44198a0 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:23:24.164931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:23:24.166600 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:23:24.166892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:23:24.167246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] PATH_INFO: `/v3/projects/809efa68c0f4428aa1d254bc9c11a7f0` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:23:24.169227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=809efa68c0f4428aa1d254bc9c11a7f0)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:23:24.171263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:23:24.217827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1212/2421] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:23:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:23:24.236946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809efa68c0f4428aa1d254bc9c11a7f0', 'request_id': 'req-be5b674d-6f95-4119-a4c9-edac9d066d0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:24.247490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809efa68c0f4428aa1d254bc9c11a7f0', 'request_id': 'req-be5b674d-6f95-4119-a4c9-edac9d066d0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:24.261073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809efa68c0f4428aa1d254bc9c11a7f0', 'request_id': 'req-be5b674d-6f95-4119-a4c9-edac9d066d0f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:24.283958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] The token cache is being invalidate because project 809efa68c0f4428aa1d254bc9c11a7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:23:24.284393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:24.285185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:23:24.287030 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1210/2422] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:23:24 2022] DELETE /identity/v3/projects/809efa68c0f4428aa1d254bc9c11a7f0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:23:34.209375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=62 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:23:34.277652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:24:40.496218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:24:40.497619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:24:40.653058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb43b80-58d2-4eba-9383-a3c2d7033188 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:24:40.720161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:24:40.720791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:24:40.721073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:24:40.721351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:24:40.723199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:24:40.736072 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:24:40.737714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:24:40.750052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1213/2423] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:24:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:24:50.745426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:26.467026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:26.468787 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:26.555709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b674d-6f95-4119-a4c9-edac9d066d0f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:26.559672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:26.560323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:26.560602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:26.560899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:26.562656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:26.653632 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:26.655117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:26.675628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1211/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:25:28.713525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:28.722719 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859360ba-dd0e-4d8c-adef-eeb79d929f4f service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:28.727228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:28.727833 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:28.728101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:28.728369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:28.730065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:28.743741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:28.745144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:28.756068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1214/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:25:36.672950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=77 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:38.751124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:40.863379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:40.864815 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:40.878929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b8254-8cad-4244-8247-6d221aa872c1 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:40.884584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:40.885782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:40.886066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:40.886374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:40.888080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:40.969028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:40.970648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:40.990411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1212/2426] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:25:46.937470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:25:46.954737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed189228-b544-49a6-a718-bda08f8bd2c3 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:25:46.962093 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:25:46.962754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:25:46.963051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:25:46.963316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:25:46.965448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:25:47.063757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:25:47.065399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:25:47.088714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1215/2427] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:25:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:25:50.987896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=41 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:25:57.085354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=41 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:26:52.671256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:26:52.672756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:26:52.687388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae73647-acd1-4eec-bc6b-43af75416745 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:26:52.693183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:26:52.693807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:26:52.694087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:26:52.694394 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:26:52.696263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:26:52.755154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:26:52.756756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:26:52.766636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1213/2428] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:26:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:27:02.761506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=28 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:27:58.228055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:27:58.229568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:27:58.244725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b965d3-3301-4c7e-a657-2753160a8f06 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:27:58.250069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41911b56-df52-43fa-9454-149c940fb193 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:27:58.250706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911b56-df52-43fa-9454-149c940fb193 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:27:58.250989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911b56-df52-43fa-9454-149c940fb193 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:27:58.251973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41911b56-df52-43fa-9454-149c940fb193 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:27:58.253675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-41911b56-df52-43fa-9454-149c940fb193 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:27:58.265049 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41911b56-df52-43fa-9454-149c940fb193 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:27:58.266658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41911b56-df52-43fa-9454-149c940fb193 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:27:58.276655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1216/2429] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:27:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:00.024923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:00.035450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c46b-7ca4-4c17-9c05-288710337ff5 service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:00.039378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:00.039993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:00.040274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:00.040548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:00.042928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:00.151505 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:00.153344 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:00.176212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1214/2430] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:00.583745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:00.584306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:00.584306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:00.606767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] MFA Rules not processed for user `b637e39164d5418f88eb442894c2ad46`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:00.615407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:00.626136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1217/2431] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:01.170470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:01.182880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d429da0-a2b7-47db-8b69-9f5c44f04c36 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:01.187350 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:01.188062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:01.188399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:01.188903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:01.191204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:01.202628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:01.205650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:01.217674 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1215/2432] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:01.757208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:01.758694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:01.777443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247491a-b883-4e8a-af77-31e17c7a89e5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:01.786068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:01.788306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:01.788831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:01.792792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:01.795415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:01.810463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:01.812654 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:01.836489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1218/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:02.402982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:02.412562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab362cf-bfb6-4247-80e8-b8666a305563 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:02.416436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:02.417041 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:02.417322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:02.417612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:02.419358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:02.432572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:02.434124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:02.445902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1216/2434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:04.061080 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:04.075462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a00709-6c8f-4f3a-b582-997f35840fe6 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:04.083655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:04.084960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:04.085342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:04.085710 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:04.087891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:04.113997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:04.115592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:04.128246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1219/2435] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:04.144151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:04.145651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:04.161536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202a23-62a4-4e16-bf32-816fb1dabcab service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:04.168656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:04.169447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:04.169778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:04.170299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] PATH_INFO: `/v3/users/93c8237bd14c40dda53daecb949a33ae` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:04.174275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c8237bd14c40dda53daecb949a33ae)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:04.176256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:04.254887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c8237bd14c40dda53daecb949a33ae'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.277187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c8237bd14c40dda53daecb949a33ae'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.285707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c8237bd14c40dda53daecb949a33ae'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.286583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c8237bd14c40dda53daecb949a33ae'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.297710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-13e073d6-acfc-45e1-a8ba-b98caffeb080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c8237bd14c40dda53daecb949a33ae'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.306440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1217/2436] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:04 2022] DELETE /identity/v3/users/93c8237bd14c40dda53daecb949a33ae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:04.549218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:04.569539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e587d-b2b4-4bcb-b410-de3d07b8c501 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:04.651529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:04.652178 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:04.653042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:04.653389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] PATH_INFO: `/v3/projects/3f10afed724e47cfab9f438411d73992` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:04.656010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f10afed724e47cfab9f438411d73992)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:04.658649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:04.735066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f10afed724e47cfab9f438411d73992', 'request_id': 'req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.755743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f10afed724e47cfab9f438411d73992', 'request_id': 'req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.763458 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f10afed724e47cfab9f438411d73992', 'request_id': 'req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.777495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] The token cache is being invalidate because project 3f10afed724e47cfab9f438411d73992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:04.777800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.778528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f62fa16-1ab5-4555-b0dc-7be03fcd913c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:04.780383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1220/2437] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:04 2022] DELETE /identity/v3/projects/3f10afed724e47cfab9f438411d73992 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:04.786278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35696d-cb56-43e3-b666-d91a1191658b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:04.786486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35696d-cb56-43e3-b666-d91a1191658b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:04.786633 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35696d-cb56-43e3-b666-d91a1191658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:04.805198 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:04.869414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6c35696d-cb56-43e3-b666-d91a1191658b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:04.871357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6c35696d-cb56-43e3-b666-d91a1191658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:04.953763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1218/2438] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:04.962555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988e87-eefb-4fbd-ba07-89f6a7142104 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:04.962842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988e87-eefb-4fbd-ba07-89f6a7142104 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:04.963162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1988e87-eefb-4fbd-ba07-89f6a7142104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:04.986655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b1988e87-eefb-4fbd-ba07-89f6a7142104 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:04.987896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b1988e87-eefb-4fbd-ba07-89f6a7142104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:04.997349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1221/2439] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:05.003118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35696d-cb56-43e3-b666-d91a1191658b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:05.014736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35696d-cb56-43e3-b666-d91a1191658b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:05.021968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:05.022757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.023038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.023308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.024059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:05.024428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:05.026723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:05.045996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1219/2440] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:05.048292 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988e87-eefb-4fbd-ba07-89f6a7142104 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:05.058702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1988e87-eefb-4fbd-ba07-89f6a7142104 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:05.065934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:05.066944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.067362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.067709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.068452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:05.070489 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:05.117467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1222/2441] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:05 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:05.118763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:05.133480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d650784-d6db-4c6c-a9ad-25b837997060 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:05.198959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:05.199643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.199992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.200335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.201208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:05.203269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:05.227173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1220/2442] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:05 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:05.232844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:05.244170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83494d99-11f6-4fe2-bc84-3bef99e06709 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:05.249040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:05.249657 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.249936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.250202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.250884 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:05.252642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:05.254545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:05.272516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1223/2443] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:05.273669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:05.285515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396401bd-21b1-4a28-9396-49f175ba11dd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:05.290523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf993082-f5ca-45f7-8b4e-0651ef5d6d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:05.291281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993082-f5ca-45f7-8b4e-0651ef5d6d22 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.291931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993082-f5ca-45f7-8b4e-0651ef5d6d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.292260 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf993082-f5ca-45f7-8b4e-0651ef5d6d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.292916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf993082-f5ca-45f7-8b4e-0651ef5d6d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:05.294662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf993082-f5ca-45f7-8b4e-0651ef5d6d22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:05.307654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1221/2444] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:05.311289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:05.322301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e3b1f-55c7-47d8-a22b-1678cb1e1dcb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:05.327662 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:05.328336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.328820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.329840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] PATH_INFO: `/v3/projects/4d5de67fed7940a2aceafdcfc91952e8/users/9d7968b309ad47cf85405ef7310bbfff/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.348893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5de67fed7940a2aceafdcfc91952e8, user_id=9d7968b309ad47cf85405ef7310bbfff, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:05.351769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:05.367373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1224/2445] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:05 2022] PUT /identity/v3/projects/4d5de67fed7940a2aceafdcfc91952e8/users/9d7968b309ad47cf85405ef7310bbfff/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:05.379026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea132c3a-3021-4155-a015-595d7332297e None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.379500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea132c3a-3021-4155-a015-595d7332297e None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.379932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea132c3a-3021-4155-a015-595d7332297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.412105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ea132c3a-3021-4155-a015-595d7332297e None None] MFA Rules not processed for user `9d7968b309ad47cf85405ef7310bbfff`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:05.413347 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ea132c3a-3021-4155-a015-595d7332297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:05.468073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:05.513159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1222/2446] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:05.529635 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:05.543173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:05.673878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5725f-229c-41e4-ad4b-fb6665a6aa39 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:05.682191 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:05.682861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:05.683139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:05.683418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:05.707641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:05.710661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:05.729693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1225/2447] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:06.481259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea132c3a-3021-4155-a015-595d7332297e None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:06.483648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ea132c3a-3021-4155-a015-595d7332297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:06.528949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:06.530921 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:06.584951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea132c3a-3021-4155-a015-595d7332297e None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:06.599475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:06.600110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:06.600392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:06.600730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:06.602497 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:06.612068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fd069-e724-427f-b06c-1d3b6cd1a2d2 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:06.615584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:06.617194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:06.617774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:06.618447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:06.618732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:06.618999 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] PATH_INFO: `/v3/users/98fc7b08006741ae9b0a217ce7fe8c92` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:06.620143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fc7b08006741ae9b0a217ce7fe8c92)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:06.622054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:06.628750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1223/2448] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:06.675584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fc7b08006741ae9b0a217ce7fe8c92'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:06.683536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:06.689421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fc7b08006741ae9b0a217ce7fe8c92'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:06.697263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fc7b08006741ae9b0a217ce7fe8c92'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:06.704553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fc7b08006741ae9b0a217ce7fe8c92'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:06.705261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-63319881-c019-4d95-aa42-d9d521468b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fc7b08006741ae9b0a217ce7fe8c92'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:06.711133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1226/2449] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:06 2022] DELETE /identity/v3/users/98fc7b08006741ae9b0a217ce7fe8c92 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:06.950128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:06.964690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a981a60-87b7-4be4-9b1e-0b5fc1eb34d2 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.033523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.034163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.034515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.035439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] PATH_INFO: `/v3/projects/0a10226de44d4050839cfa0a11066bc7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.036389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a10226de44d4050839cfa0a11066bc7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.038433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.107535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a10226de44d4050839cfa0a11066bc7', 'request_id': 'req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:07.119048 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a10226de44d4050839cfa0a11066bc7', 'request_id': 'req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:07.128998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a10226de44d4050839cfa0a11066bc7', 'request_id': 'req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:07.133988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:07.141716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] The token cache is being invalidate because project 0a10226de44d4050839cfa0a11066bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:07.142252 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:07.143139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2265c2a6-03c2-4bb8-99d7-6cafb77a498f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:07.144783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1224/2450] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:06 2022] DELETE /identity/v3/projects/0a10226de44d4050839cfa0a11066bc7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:07.149771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986866-4d2a-472a-a89a-e0248a3bbbf0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.150065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986866-4d2a-472a-a89a-e0248a3bbbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.150374 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8986866-4d2a-472a-a89a-e0248a3bbbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.176150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d8986866-4d2a-472a-a89a-e0248a3bbbf0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:07.177389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d8986866-4d2a-472a-a89a-e0248a3bbbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:07.238362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1227/2451] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:07.246591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121a698-86d7-4450-ab45-27e047d160d6 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.246892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121a698-86d7-4450-ab45-27e047d160d6 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.247159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121a698-86d7-4450-ab45-27e047d160d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.269504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1121a698-86d7-4450-ab45-27e047d160d6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:07.270869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1121a698-86d7-4450-ab45-27e047d160d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:07.279148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1225/2452] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:07.284107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8986866-4d2a-472a-a89a-e0248a3bbbf0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.294018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8986866-4d2a-472a-a89a-e0248a3bbbf0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.298825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.299434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.299717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.299995 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.300653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:07.300957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.302613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.314992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1228/2453] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:07.319388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121a698-86d7-4450-ab45-27e047d160d6 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.328966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121a698-86d7-4450-ab45-27e047d160d6 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.335002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.335612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.335892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.336162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.336805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.338746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.367268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1226/2454] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:07 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:07.371391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.381433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209c81-9898-45f0-8af3-09f10d0fdff6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.437487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.438097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.438388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.438668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.439383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.441284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.476392 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1229/2455] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:07 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:07.477628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.489062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe6fbb-eceb-470c-874e-db5a6284c469 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.495004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.498232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.498616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.498954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.499626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.501822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.512913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1227/2456] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:07.516935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.530370 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a884e-38e7-407b-88d6-a870da63f40b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.538474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfb3e6-35c6-41a2-9a6a-1d66957f067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.539513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb3e6-35c6-41a2-9a6a-1d66957f067f admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.540002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb3e6-35c6-41a2-9a6a-1d66957f067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.540488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfb3e6-35c6-41a2-9a6a-1d66957f067f admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.541694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfb3e6-35c6-41a2-9a6a-1d66957f067f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.544911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bfb3e6-35c6-41a2-9a6a-1d66957f067f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.567871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1230/2457] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:07.572445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.583121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed425e-a85a-4115-bb02-bb5e098689ae admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.593045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.593717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.594052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.594718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] PATH_INFO: `/v3/projects/a42abe65e7bf4308a64fb781af536926/users/7884de0b7619465b8d89440175edbc01/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.613255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42abe65e7bf4308a64fb781af536926, user_id=7884de0b7619465b8d89440175edbc01, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.615986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.630088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1228/2458] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:07 2022] PUT /identity/v3/projects/a42abe65e7bf4308a64fb781af536926/users/7884de0b7619465b8d89440175edbc01/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:07.645781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462356bb-63f8-4e10-ba59-c8603a7a59ea None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.646345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462356bb-63f8-4e10-ba59-c8603a7a59ea None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.646587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462356bb-63f8-4e10-ba59-c8603a7a59ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.679934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-462356bb-63f8-4e10-ba59-c8603a7a59ea None None] MFA Rules not processed for user `7884de0b7619465b8d89440175edbc01`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:07.681171 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-462356bb-63f8-4e10-ba59-c8603a7a59ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:07.714862 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:07.760433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1231/2459] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:07.764821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.828033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e832f-6f7e-40ff-a52e-42db69c13f3e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.833053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.833711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.834040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.834339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.834978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.836965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.870981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1229/2460] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:07 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:07.872057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462356bb-63f8-4e10-ba59-c8603a7a59ea None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.883477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462356bb-63f8-4e10-ba59-c8603a7a59ea None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.946394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.947013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.947295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.947568 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.948209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.950129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:07.972850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1232/2461] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:07 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:07.977186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:07.987556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81236172-714d-4e9d-b35e-34b7069df42b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:07.992449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:07.993064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:07.993372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:07.993662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:07.994358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:07.995960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:08.007977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1230/2462] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:08.012197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:08.022747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd212c-a4d0-4639-b286-34306dd07df2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:08.027492 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:08.028140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:08.028420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:08.028696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] PATH_INFO: `/v3/projects/0f2d04e6aa1447d3893f0bd842788b67/users/fd731e1f612f41aabfa756a592cb5a43/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:08.044148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2d04e6aa1447d3893f0bd842788b67, user_id=fd731e1f612f41aabfa756a592cb5a43, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:08.046880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:08.059675 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1233/2463] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:08 2022] PUT /identity/v3/projects/0f2d04e6aa1447d3893f0bd842788b67/users/fd731e1f612f41aabfa756a592cb5a43/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:08.063686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:08.073910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d250ea2-593a-4029-9ff2-d3977cbe0deb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:08.129647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c691e-2efb-4afa-ac59-3ebe54a9bcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:08.130172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c691e-2efb-4afa-ac59-3ebe54a9bcea admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:08.130482 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c691e-2efb-4afa-ac59-3ebe54a9bcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:08.130755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c691e-2efb-4afa-ac59-3ebe54a9bcea admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:08.131399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c691e-2efb-4afa-ac59-3ebe54a9bcea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:08.133003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c691e-2efb-4afa-ac59-3ebe54a9bcea admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:08.146504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1231/2464] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:08.150549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:08.164755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77ac80-b61c-480d-9481-ecc2ab12aa01 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:08.167099 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:08.167800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:08.168105 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:08.168373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] PATH_INFO: `/v3/projects/0f2d04e6aa1447d3893f0bd842788b67/users/fd731e1f612f41aabfa756a592cb5a43/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:08.170380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2d04e6aa1447d3893f0bd842788b67, user_id=fd731e1f612f41aabfa756a592cb5a43, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:08.173133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:08.184790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1234/2465] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:08 2022] PUT /identity/v3/projects/0f2d04e6aa1447d3893f0bd842788b67/users/fd731e1f612f41aabfa756a592cb5a43/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:08.195376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:08.195982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:08.196262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:08.203642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:08.230040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] MFA Rules not processed for user `fd731e1f612f41aabfa756a592cb5a43`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:08.231285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:08.301716 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1232/2466] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:08.313291 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:08.315035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:08.400691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3385c-6472-4ca6-a119-27e24797b545 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:08.404457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297174a-f905-457f-a7e8-3900702340d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:08.405066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297174a-f905-457f-a7e8-3900702340d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:08.405344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297174a-f905-457f-a7e8-3900702340d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:08.405614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297174a-f905-457f-a7e8-3900702340d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:08.423268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:08.479845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297174a-f905-457f-a7e8-3900702340d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:08.481314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297174a-f905-457f-a7e8-3900702340d8 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:08.490837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1235/2467] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:08.859443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:08.862355 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:08.930768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4019a3-d52e-4c0e-8c97-fb2d49488624 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:08.935218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:08.935845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:08.936123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:08.936396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] PATH_INFO: `/v3/users/9d7968b309ad47cf85405ef7310bbfff` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:08.937504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7968b309ad47cf85405ef7310bbfff)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:08.940267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:08.989595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7968b309ad47cf85405ef7310bbfff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.002643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7968b309ad47cf85405ef7310bbfff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.009570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7968b309ad47cf85405ef7310bbfff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.010336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7968b309ad47cf85405ef7310bbfff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.018087 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7968b309ad47cf85405ef7310bbfff'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.024778 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1233/2468] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:08 2022] DELETE /identity/v3/users/9d7968b309ad47cf85405ef7310bbfff => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:09.029366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.029858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.030182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.049796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:09.052223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:09.113449 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1236/2469] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:09.123222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:09.124686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:09.137529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:09.191128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f299-7937-4faa-b48b-fc19868384ba admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:09.194721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35ca04-3bd3-41ea-a1bd-47daae52fe72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:09.195323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35ca04-3bd3-41ea-a1bd-47daae52fe72 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.195601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35ca04-3bd3-41ea-a1bd-47daae52fe72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.195871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35ca04-3bd3-41ea-a1bd-47daae52fe72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.205469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35ca04-3bd3-41ea-a1bd-47daae52fe72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:09.206967 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35ca04-3bd3-41ea-a1bd-47daae52fe72 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:09.216854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1234/2470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:09.499661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:09.501871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:09.514834 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db775a50-2894-4e1f-9c1f-ce310166eebc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:09.520014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:09.520963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.521258 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.521601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] PATH_INFO: `/v3/projects/4d5de67fed7940a2aceafdcfc91952e8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.522725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5de67fed7940a2aceafdcfc91952e8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:09.525908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:09.581003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5de67fed7940a2aceafdcfc91952e8', 'request_id': 'req-32ebc320-d2d8-4574-add0-d03b53cb26f3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.588598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5de67fed7940a2aceafdcfc91952e8', 'request_id': 'req-32ebc320-d2d8-4574-add0-d03b53cb26f3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.599216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5de67fed7940a2aceafdcfc91952e8', 'request_id': 'req-32ebc320-d2d8-4574-add0-d03b53cb26f3'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.609800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] The token cache is being invalidate because project 4d5de67fed7940a2aceafdcfc91952e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:09.610086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.611270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-32ebc320-d2d8-4574-add0-d03b53cb26f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:09.612802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1237/2471] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:09 2022] DELETE /identity/v3/projects/4d5de67fed7940a2aceafdcfc91952e8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:09.617774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3458-c0ff-4c72-9e1b-01e098aa8efe None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.618061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3458-c0ff-4c72-9e1b-01e098aa8efe None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.618381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c3458-c0ff-4c72-9e1b-01e098aa8efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.638442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ab1c3458-c0ff-4c72-9e1b-01e098aa8efe None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:09.639650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ab1c3458-c0ff-4c72-9e1b-01e098aa8efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:09.700170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1235/2472] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:09.709259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d443-66cd-46d3-a378-8be0f1333baf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.709548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d443-66cd-46d3-a378-8be0f1333baf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.709830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d443-66cd-46d3-a378-8be0f1333baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.731337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-4820d443-66cd-46d3-a378-8be0f1333baf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:09.732556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4820d443-66cd-46d3-a378-8be0f1333baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:09.741611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1238/2473] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:09.745814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c3458-c0ff-4c72-9e1b-01e098aa8efe None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:09.756652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c3458-c0ff-4c72-9e1b-01e098aa8efe None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:09.769928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:09.770595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.770875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.771147 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.771802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:09.772104 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:09.774014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:09.790919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1236/2474] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:09.792026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d443-66cd-46d3-a378-8be0f1333baf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:09.802558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820d443-66cd-46d3-a378-8be0f1333baf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:09.807676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:09.808256 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.808584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.808798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.809444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:09.811366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:09.842267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1239/2475] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:09 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:09.846266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:09.858053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22593193-870d-4f79-9325-2fb32539737d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:09.893415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:09.895187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:09.911533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:09.936446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:09.937055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.937342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.937613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.938258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:09.940782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:09.964901 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7864b531-3154-40ff-8cdb-f3fdb26ed241 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:09.967115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1237/2476] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:09 2022] POST /identity/v3/users => generated 303 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:09.968944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f516a6e-0d56-4732-bc4b-9abbfa3b99c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:09.969559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516a6e-0d56-4732-bc4b-9abbfa3b99c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.969982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516a6e-0d56-4732-bc4b-9abbfa3b99c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.970353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516a6e-0d56-4732-bc4b-9abbfa3b99c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.971310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:09.972312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3f516a6e-0d56-4732-bc4b-9abbfa3b99c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:09.981627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa1379-3bd2-4363-9e41-ab74830c1314 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:09.986709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:09.987314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:09.987591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:09.987864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:09.988534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:09.990169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:10.001726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1238/2477] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:10.005229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:10.015032 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22b10c-f5be-4409-8409-9c43a2620d42 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:10.020585 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:10.021179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:10.021456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:10.021825 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:10.022583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:10.024179 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:10.037150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1239/2478] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:10.038142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:10.039145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f516a6e-0d56-4732-bc4b-9abbfa3b99c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:10.040576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f516a6e-0d56-4732-bc4b-9abbfa3b99c3 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:10.044319 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:10.048346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfbfd8-4bad-41f6-a95c-5f056819105a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:10.052507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1240/2479] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:10.057625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:10.058325 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:10.058610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:10.058888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] PATH_INFO: `/v3/projects/fe6f2dc7fc3443f9962b61a3736b4f55/users/f89295403037477c90177b8478e844f7/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:10.076080 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6f2dc7fc3443f9962b61a3736b4f55, user_id=f89295403037477c90177b8478e844f7, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:10.079101 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:10.096555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1240/2480] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:10 2022] PUT /identity/v3/projects/fe6f2dc7fc3443f9962b61a3736b4f55/users/f89295403037477c90177b8478e844f7/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:10.101973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028271-96b8-4e10-94a0-b74e08f5a413 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:10.102722 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028271-96b8-4e10-94a0-b74e08f5a413 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:10.103112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb028271-96b8-4e10-94a0-b74e08f5a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:10.132192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-fb028271-96b8-4e10-94a0-b74e08f5a413 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:10.133637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-fb028271-96b8-4e10-94a0-b74e08f5a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:10.233455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1241/2481] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:10.239794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:10.241529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:10.304813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bfb9e-5467-4ae5-b617-b3b398f90589 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:10.309433 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:10.310108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:10.310416 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:10.310688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:10.321044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:10.323002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:10.333591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1241/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:11.062368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f6765-9585-4ec1-8ae2-a34db255a4ae None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:11.062914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f6765-9585-4ec1-8ae2-a34db255a4ae None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:11.062914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f6765-9585-4ec1-8ae2-a34db255a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:11.100114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ca1f6765-9585-4ec1-8ae2-a34db255a4ae None None] MFA Rules not processed for user `f89295403037477c90177b8478e844f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:11.101281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ca1f6765-9585-4ec1-8ae2-a34db255a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:11.163601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:11.174577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1242/2483] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:11.179310 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:11.190395 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c7eb-bd38-43d5-85d8-d2214f7db598 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:11.195287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:11.195927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:11.196205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:11.196479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:11.197117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:11.199084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:11.232134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1242/2484] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:11 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:11.236953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f6765-9585-4ec1-8ae2-a34db255a4ae None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:11.248514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f6765-9585-4ec1-8ae2-a34db255a4ae None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:11.313303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:11.314639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:11.314916 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:11.315183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:11.315942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:11.317897 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:11.341791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1243/2485] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:11 2022] POST /identity/v3/users => generated 308 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:11.348194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:11.359077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d332ba-8fe4-4183-b125-d2b98c753d86 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:11.369939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:11.370680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:11.371353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:11.371485 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:11.372091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:11.373899 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:11.385816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1243/2486] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:11.390015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:11.400474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252875d-3c80-47e6-8103-88608cfbcd86 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:11.405547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:11.406353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:11.406733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:11.407107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] PATH_INFO: `/v3/projects/a944b323927c4d8fab37e21ed1aa96a0/users/98c9958376574bb687d9f563a79d1567/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:11.425128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a944b323927c4d8fab37e21ed1aa96a0, user_id=98c9958376574bb687d9f563a79d1567, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:11.427873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:11.443471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1244/2487] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:11 2022] PUT /identity/v3/projects/a944b323927c4d8fab37e21ed1aa96a0/users/98c9958376574bb687d9f563a79d1567/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:11.447515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:11.458819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb43b0-f6e7-414b-8c3d-d6d86e80a8a4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:11.530791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43c619-8714-4d91-a65d-f0f30993ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:11.530791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43c619-8714-4d91-a65d-f0f30993ad6a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:11.530791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43c619-8714-4d91-a65d-f0f30993ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:11.530791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43c619-8714-4d91-a65d-f0f30993ad6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:11.531323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43c619-8714-4d91-a65d-f0f30993ad6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:11.532991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43c619-8714-4d91-a65d-f0f30993ad6a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:11.544304 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1244/2488] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:11.550378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:11.565158 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a7d6b-4880-42e0-bbfc-357acf5a0048 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:11.574929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:11.575845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:11.576353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:11.576580 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] PATH_INFO: `/v3/projects/a944b323927c4d8fab37e21ed1aa96a0/users/98c9958376574bb687d9f563a79d1567/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:11.578640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a944b323927c4d8fab37e21ed1aa96a0, user_id=98c9958376574bb687d9f563a79d1567, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:11.581523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:11.595892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1245/2489] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:11 2022] PUT /identity/v3/projects/a944b323927c4d8fab37e21ed1aa96a0/users/98c9958376574bb687d9f563a79d1567/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:12.271925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:12.272428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:12.272548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:12.304854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] MFA Rules not processed for user `98c9958376574bb687d9f563a79d1567`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:12.306422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:12.345342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:12.382940 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1245/2490] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:13.651344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:13.715637 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce88e2-d66d-4b88-9cf5-accbe7e2d005 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:13.720858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:13.721485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:13.721768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:13.722163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] PATH_INFO: `/v3/users/f89295403037477c90177b8478e844f7` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:13.724050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89295403037477c90177b8478e844f7)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:13.725987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:13.777930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89295403037477c90177b8478e844f7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:13.779102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:13.796413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89295403037477c90177b8478e844f7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:13.805964 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89295403037477c90177b8478e844f7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:13.814211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89295403037477c90177b8478e844f7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:13.815095 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89295403037477c90177b8478e844f7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:13.821342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1246/2491] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:13 2022] DELETE /identity/v3/users/f89295403037477c90177b8478e844f7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:13.968725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:13.970947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:13.987712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93696bf3-569d-4519-896f-39b7a245e228 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:14.011325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:14.012843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.057732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:14.058673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.058951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.059221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] PATH_INFO: `/v3/users/7884de0b7619465b8d89440175edbc01` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.060455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7884de0b7619465b8d89440175edbc01)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:14.062725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:14.093679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c4003-dcef-473c-976c-1fa5672af7ec admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:14.100236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:14.100882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.101174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.101451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] PATH_INFO: `/v3/projects/fe6f2dc7fc3443f9962b61a3736b4f55` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.103038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6f2dc7fc3443f9962b61a3736b4f55)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:14.105196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:14.112271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7884de0b7619465b8d89440175edbc01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.125037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7884de0b7619465b8d89440175edbc01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.134368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7884de0b7619465b8d89440175edbc01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.135532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7884de0b7619465b8d89440175edbc01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.143593 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-394c85d7-2e46-44b9-adf8-9e3c2cf87f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7884de0b7619465b8d89440175edbc01'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.150132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1246/2492] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:13 2022] DELETE /identity/v3/users/7884de0b7619465b8d89440175edbc01 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:14.154735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.155010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.155266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.156831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6f2dc7fc3443f9962b61a3736b4f55', 'request_id': 'req-60b8900c-20e1-4faf-8a76-53fe82bf020b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.165406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6f2dc7fc3443f9962b61a3736b4f55', 'request_id': 'req-60b8900c-20e1-4faf-8a76-53fe82bf020b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.173372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6f2dc7fc3443f9962b61a3736b4f55', 'request_id': 'req-60b8900c-20e1-4faf-8a76-53fe82bf020b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.177737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:14.178994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.187366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] The token cache is being invalidate because project fe6f2dc7fc3443f9962b61a3736b4f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:14.187638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.188299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.190522 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1247/2493] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:14 2022] DELETE /identity/v3/projects/fe6f2dc7fc3443f9962b61a3736b4f55 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:14.195506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:14.196900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.233161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:14.253829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1247/2494] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:14.264478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:14.266042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.282576 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:14.290784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8900c-20e1-4faf-8a76-53fe82bf020b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:14.302142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:14.302978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.303262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.303535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] PATH_INFO: `/v3/users/98c9958376574bb687d9f563a79d1567` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.304720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c9958376574bb687d9f563a79d1567)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:14.306763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:14.344021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5151392-c057-4c1b-89be-8db2cc133f2d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:14.349082 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:14.349675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.349952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.350229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.361354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:14.363259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:14.366768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c9958376574bb687d9f563a79d1567'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.374595 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1248/2495] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:14.382621 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c9958376574bb687d9f563a79d1567'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.390923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c9958376574bb687d9f563a79d1567'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.399452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c9958376574bb687d9f563a79d1567'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.400140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c9958376574bb687d9f563a79d1567'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.406209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1248/2496] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:14 2022] DELETE /identity/v3/users/98c9958376574bb687d9f563a79d1567 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:14.592476 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:14.609612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc74e-673b-47d6-842c-d18f836148c9 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:14.664252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:14.665761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.684495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:14.686968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.687450 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.687921 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] PATH_INFO: `/v3/projects/a944b323927c4d8fab37e21ed1aa96a0` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.690123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a944b323927c4d8fab37e21ed1aa96a0)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:14.696639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:14.755239 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc315b5-bfc6-4d0a-9558-3ebf0f0f5481 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:14.763143 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a944b323927c4d8fab37e21ed1aa96a0', 'request_id': 'req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.771943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a944b323927c4d8fab37e21ed1aa96a0', 'request_id': 'req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.778703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a944b323927c4d8fab37e21ed1aa96a0', 'request_id': 'req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.790495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] The token cache is being invalidate because project a944b323927c4d8fab37e21ed1aa96a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:14.790887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.791540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-50a3610a-f0f4-49a9-ac3f-c258f5d4f20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.793329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1249/2497] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:14 2022] DELETE /identity/v3/projects/a944b323927c4d8fab37e21ed1aa96a0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:14.797857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93468-8a58-4f66-bbd4-4e3b5dcdf645 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.798203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93468-8a58-4f66-bbd4-4e3b5dcdf645 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.798534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca93468-8a58-4f66-bbd4-4e3b5dcdf645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.816541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:14.817278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.817638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.818004 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] PATH_INFO: `/v3/projects/a42abe65e7bf4308a64fb781af536926` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.819281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42abe65e7bf4308a64fb781af536926)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:14.820055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bca93468-8a58-4f66-bbd4-4e3b5dcdf645 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:14.821272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bca93468-8a58-4f66-bbd4-4e3b5dcdf645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.821398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:14.836760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1250/2498] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:14.838691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f706-8bac-4e28-ac19-ab91fe659468 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.839015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f706-8bac-4e28-ac19-ab91fe659468 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.839296 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f706-8bac-4e28-ac19-ab91fe659468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.857770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:14.862886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-cc76f706-8bac-4e28-ac19-ab91fe659468 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:14.865111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-cc76f706-8bac-4e28-ac19-ab91fe659468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.883466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:14.888646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42abe65e7bf4308a64fb781af536926', 'request_id': 'req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.901005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42abe65e7bf4308a64fb781af536926', 'request_id': 'req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.908942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42abe65e7bf4308a64fb781af536926', 'request_id': 'req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.925276 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] The token cache is being invalidate because project a42abe65e7bf4308a64fb781af536926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:14.925974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.927063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:14.928929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1249/2499] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:14 2022] DELETE /identity/v3/projects/a42abe65e7bf4308a64fb781af536926 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:14.932905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:14.934573 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:14.948698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1251/2500] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:14.953060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f706-8bac-4e28-ac19-ab91fe659468 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:14.964130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f706-8bac-4e28-ac19-ab91fe659468 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:14.970671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:14.971446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:14.971735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:14.972074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:14.973064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:14.973431 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:14.975149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:14.991266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1252/2501] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:28:14.992448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.003103 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5725f-73e7-474a-88d3-18a083471198 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.008738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ecc0d-7a39-4a27-8a07-6c92251a813d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.015338 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.015856 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.016137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.017017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.017201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.017463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.017659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] PATH_INFO: `/v3/users/fd731e1f612f41aabfa756a592cb5a43` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.017830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.018697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.018842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd731e1f612f41aabfa756a592cb5a43)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.020771 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.020924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.053203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1253/2502] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:14 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:15.057563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.075499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd731e1f612f41aabfa756a592cb5a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.089667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd731e1f612f41aabfa756a592cb5a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.100749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd731e1f612f41aabfa756a592cb5a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.108152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd731e1f612f41aabfa756a592cb5a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.108815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd731e1f612f41aabfa756a592cb5a43'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.115531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1250/2503] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:14 2022] DELETE /identity/v3/users/fd731e1f612f41aabfa756a592cb5a43 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:15.127936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576c37f-3236-4fff-a942-f721247180f9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.186936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.187714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.188077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.188968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.189710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.191737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.217231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1254/2504] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:15.218529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.219945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:15.233484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed59f-b005-46f4-b659-6b24c510854b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.238624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.239250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.239528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.239800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.240525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.242096 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.256832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1251/2505] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:15.258463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.274548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c59be-33de-42e7-a1af-dd7b58d92c77 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.279840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d82a4-7582-4d2f-8174-ff4c72f52114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.280465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d82a4-7582-4d2f-8174-ff4c72f52114 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.280739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d82a4-7582-4d2f-8174-ff4c72f52114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.281146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d82a4-7582-4d2f-8174-ff4c72f52114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.281659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d82a4-7582-4d2f-8174-ff4c72f52114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.283670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d82a4-7582-4d2f-8174-ff4c72f52114 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.295440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1255/2506] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:15.299827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.310139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8a462-3ed6-4826-b2e3-bc204c5420c0 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.316026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.316781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.317130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.317434 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] PATH_INFO: `/v3/projects/750b9f1e81d54f1b9129e9133aea86e9/users/59c6df8447924cb4a581fb7a76c29eea/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.336123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750b9f1e81d54f1b9129e9133aea86e9, user_id=59c6df8447924cb4a581fb7a76c29eea, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.339063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.342748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:15.358331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1252/2507] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:15 2022] PUT /identity/v3/projects/750b9f1e81d54f1b9129e9133aea86e9/users/59c6df8447924cb4a581fb7a76c29eea/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:15.367271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60913e8-3f4e-4e54-9677-a2c4894636a2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.367590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60913e8-3f4e-4e54-9677-a2c4894636a2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.367841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60913e8-3f4e-4e54-9677-a2c4894636a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.395863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:15.407271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b60913e8-3f4e-4e54-9677-a2c4894636a2 None None] MFA Rules not processed for user `59c6df8447924cb4a581fb7a76c29eea`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:15.408610 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b60913e8-3f4e-4e54-9677-a2c4894636a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:15.436144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.437967 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:15.502547 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1256/2508] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:15.507026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60913e8-3f4e-4e54-9677-a2c4894636a2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.514642 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bc083-5463-4744-958f-788399934b93 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.517550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60913e8-3f4e-4e54-9677-a2c4894636a2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.520593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.521225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.521505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.521775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] PATH_INFO: `/v3/projects/0f2d04e6aa1447d3893f0bd842788b67` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.522912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2d04e6aa1447d3893f0bd842788b67)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.523637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.524241 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.524520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.524792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.524899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.525419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.527343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.561814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1257/2509] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:15.567088 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.581344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2d04e6aa1447d3893f0bd842788b67', 'request_id': 'req-c5d2ea63-66ba-479f-a667-2a362390499d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.597975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2d04e6aa1447d3893f0bd842788b67', 'request_id': 'req-c5d2ea63-66ba-479f-a667-2a362390499d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.604873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2d04e6aa1447d3893f0bd842788b67', 'request_id': 'req-c5d2ea63-66ba-479f-a667-2a362390499d'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.615942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] The token cache is being invalidate because project 0f2d04e6aa1447d3893f0bd842788b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:15.616231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.616933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c5d2ea63-66ba-479f-a667-2a362390499d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:15.618480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1253/2510] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:15 2022] DELETE /identity/v3/projects/0f2d04e6aa1447d3893f0bd842788b67 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:15.623193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68e043-8c10-41b8-86d4-1ac5923fd76a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.623477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68e043-8c10-41b8-86d4-1ac5923fd76a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.623752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68e043-8c10-41b8-86d4-1ac5923fd76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.633059 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835af9b3-e38e-4cbc-90b4-0b95ab511a25 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.644007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9f68e043-8c10-41b8-86d4-1ac5923fd76a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:15.645222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9f68e043-8c10-41b8-86d4-1ac5923fd76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:15.690948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.691421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.691730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.692115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.692750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.694777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.708484 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1254/2511] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:15.716159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006658-3661-441c-a20a-0892f93e65fa None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.716447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006658-3661-441c-a20a-0892f93e65fa None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.716725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c006658-3661-441c-a20a-0892f93e65fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.717131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1258/2512] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:15.721459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.723640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:15.736469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c13517-9a4b-459f-84db-42cbd36e1762 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.738994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8c006658-3661-441c-a20a-0892f93e65fa None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:15.740230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8c006658-3661-441c-a20a-0892f93e65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:15.741653 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.742288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.742565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.742924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.743626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.745254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.748914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1255/2513] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:15.753279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c006658-3661-441c-a20a-0892f93e65fa None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.758603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1259/2514] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:15.759978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.762470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c006658-3661-441c-a20a-0892f93e65fa None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.765372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:15.768249 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.768855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.769133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.769406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.770054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:15.770520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.772053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.773002 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37cb88c-1d03-41ec-a3e1-339eeec157fc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.778808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.779840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.780125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.780710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] PATH_INFO: `/v3/projects/c339c9b1f15548a4ba6eee843d42dbad/users/2e014b7fcfab4ab7b0e6ba979337b2f0/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.788544 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1256/2515] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:15.792986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.801525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c339c9b1f15548a4ba6eee843d42dbad, user_id=2e014b7fcfab4ab7b0e6ba979337b2f0, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.802871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee591a-21a3-4f8d-9245-2748edb6c841 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.804608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.807779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.808388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.808668 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.808949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.809579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.811523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.817969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:15.821837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1260/2516] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:15 2022] PUT /identity/v3/projects/c339c9b1f15548a4ba6eee843d42dbad/users/2e014b7fcfab4ab7b0e6ba979337b2f0/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:15.825790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.852304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1257/2517] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:15.853298 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.906567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927e01b-520c-4c28-941a-05fa690b8064 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.919805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffa75bd-af02-4baa-beca-799e822cceb8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.924613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.925221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.925501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.925781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.926466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.928395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.955495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1258/2518] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:15 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:15.959740 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:15.967955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.968757 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.969140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.969538 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.969980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520a2fb-7bb4-49ce-b17b-5ba0f7672379 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:15.970998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.972983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.981335 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:15.981953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:15.982227 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:15.982534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:15.983196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:15.984039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1261/2519] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:15.984889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:15.989247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.002760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1259/2520] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:16.003003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8e543-23ab-4bf3-adaa-df4807b264cc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.004534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.008588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.009764 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.010157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.010638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] PATH_INFO: `/v3/projects/c339c9b1f15548a4ba6eee843d42dbad/users/2e014b7fcfab4ab7b0e6ba979337b2f0/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.014331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c339c9b1f15548a4ba6eee843d42dbad, user_id=2e014b7fcfab4ab7b0e6ba979337b2f0, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.020879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.022514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01eafd8-6531-4551-bd49-5311564317ec admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.029237 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2552f6-3bf6-46cd-8201-1c17c6769ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.030038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2552f6-3bf6-46cd-8201-1c17c6769ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.030380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2552f6-3bf6-46cd-8201-1c17c6769ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.030658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2552f6-3bf6-46cd-8201-1c17c6769ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.031314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2552f6-3bf6-46cd-8201-1c17c6769ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.033432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2552f6-3bf6-46cd-8201-1c17c6769ef8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.035224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1262/2521] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:15 2022] PUT /identity/v3/projects/c339c9b1f15548a4ba6eee843d42dbad/users/2e014b7fcfab4ab7b0e6ba979337b2f0/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:16.047849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1260/2522] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:16.052702 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.104136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.104421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.104699 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.124756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927a9e8-19e7-4a9b-9f21-15db966fd8c0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.130028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310967a3-92cf-49ec-b1dd-b3e77b135eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.130745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310967a3-92cf-49ec-b1dd-b3e77b135eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.131024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310967a3-92cf-49ec-b1dd-b3e77b135eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.131307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310967a3-92cf-49ec-b1dd-b3e77b135eaf admin admin] PATH_INFO: `/v3/projects/6b0243929e4a461297d75374934cd15e/users/5ef60d4ff3ba4fce98e593302bd74c9a/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.136981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] MFA Rules not processed for user `2e014b7fcfab4ab7b0e6ba979337b2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:16.138329 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:16.144794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:16.148429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310967a3-92cf-49ec-b1dd-b3e77b135eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0243929e4a461297d75374934cd15e, user_id=5ef60d4ff3ba4fce98e593302bd74c9a, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.151882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310967a3-92cf-49ec-b1dd-b3e77b135eaf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.170084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1263/2523] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:16 2022] PUT /identity/v3/projects/6b0243929e4a461297d75374934cd15e/users/5ef60d4ff3ba4fce98e593302bd74c9a/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:16.183691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b58f-65cd-46fc-b18a-e887ae70ce39 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.184044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b58f-65cd-46fc-b18a-e887ae70ce39 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.184329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b58f-65cd-46fc-b18a-e887ae70ce39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.214531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-1352b58f-65cd-46fc-b18a-e887ae70ce39 None None] MFA Rules not processed for user `5ef60d4ff3ba4fce98e593302bd74c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:16.215749 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1352b58f-65cd-46fc-b18a-e887ae70ce39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:16.222390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1261/2524] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:16.233288 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.234725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:16.280059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:16.288212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1264/2525] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:16.293496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b58f-65cd-46fc-b18a-e887ae70ce39 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.296840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb767f-9034-42ef-806d-c4bb40579c70 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.346923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.347811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.348125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.348407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.350232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:16.375858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b58f-65cd-46fc-b18a-e887ae70ce39 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.383730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.384373 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.384649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.384920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.385557 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.387539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.422601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1265/2526] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:16 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:16.423436 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.424686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.425101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.443548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1262/2527] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:16.495925 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a629f6a-5af1-4b08-aa8a-77920905e27a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.501650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.502447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.502722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.502994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.503672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.505645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.525097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:16.546945 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1266/2528] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:16 2022] POST /identity/v3/users => generated 303 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:16.547067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.560854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f7e8e-a9c7-4ca7-bccc-70a6d483b06f service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.566791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.567474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.567743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.568076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.568671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.570299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.581551 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1263/2529] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:16.586158 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.601575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6e294-2bf1-4eb2-aa88-7cd06a011a7c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.606563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.607261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.607537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.608011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] PATH_INFO: `/v3/projects/b635244681b646fe975cdf7bc8640ead/users/ccdf05fe227c4678b005f0fb6049e12e/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.625098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b635244681b646fe975cdf7bc8640ead, user_id=ccdf05fe227c4678b005f0fb6049e12e, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.628020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.643693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1267/2530] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:16 2022] PUT /identity/v3/projects/b635244681b646fe975cdf7bc8640ead/users/ccdf05fe227c4678b005f0fb6049e12e/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:16.647907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.659415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbde23-f541-469c-a915-2c729fb667be admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.719218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcf5e3-3cff-4363-89b5-de28f6e7ed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.720539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcf5e3-3cff-4363-89b5-de28f6e7ed2e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.720724 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcf5e3-3cff-4363-89b5-de28f6e7ed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.720895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcf5e3-3cff-4363-89b5-de28f6e7ed2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.721638 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcf5e3-3cff-4363-89b5-de28f6e7ed2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.723564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcf5e3-3cff-4363-89b5-de28f6e7ed2e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.734299 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1264/2531] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:16.744308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.756132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66538534-31b7-42ac-81e4-46c3073e4f00 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.761064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.761821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.762162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.762656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] PATH_INFO: `/v3/projects/b635244681b646fe975cdf7bc8640ead/users/ccdf05fe227c4678b005f0fb6049e12e/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.764710 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b635244681b646fe975cdf7bc8640ead, user_id=ccdf05fe227c4678b005f0fb6049e12e, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.767809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:16.783183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1268/2532] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:16 2022] PUT /identity/v3/projects/b635244681b646fe975cdf7bc8640ead/users/ccdf05fe227c4678b005f0fb6049e12e/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:16.793480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.793771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.794101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.825396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] MFA Rules not processed for user `ccdf05fe227c4678b005f0fb6049e12e`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:16.826774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:16.849387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:16.901954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1265/2533] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:16.913822 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:16.980328 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0fdc7-9d8c-4af1-9088-319c3b93fe50 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:16.984244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:16.984928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:16.985308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:16.985639 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:16.995168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:16.996673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:17.006428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1269/2534] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:17.054047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:17.055832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:17.069068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19995a-22aa-4691-9113-a7373d23baf5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:17.075943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:17.076565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:17.076852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:17.077118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:17.145038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:17.146535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:17.157929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1266/2535] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:19.067872 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:19.076502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b46c0b-258f-4f06-8663-33b137d91d1c service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:19.080871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68609799-6388-462b-9109-7dd7c25bf3f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:19.081452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68609799-6388-462b-9109-7dd7c25bf3f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:19.081736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68609799-6388-462b-9109-7dd7c25bf3f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:19.082013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68609799-6388-462b-9109-7dd7c25bf3f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:19.156740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68609799-6388-462b-9109-7dd7c25bf3f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:19.158682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68609799-6388-462b-9109-7dd7c25bf3f8 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:19.169480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1270/2536] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:20.537173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:20.618508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd6ac0-bd0f-410c-b152-85b3a56ea050 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:20.623689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:20.624466 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:20.624838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:20.625119 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] PATH_INFO: `/v3/users/5ef60d4ff3ba4fce98e593302bd74c9a` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:20.627035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef60d4ff3ba4fce98e593302bd74c9a)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:20.629102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:20.683660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef60d4ff3ba4fce98e593302bd74c9a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:20.691324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:20.701520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef60d4ff3ba4fce98e593302bd74c9a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:20.710666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef60d4ff3ba4fce98e593302bd74c9a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:20.718321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef60d4ff3ba4fce98e593302bd74c9a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:20.718984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef60d4ff3ba4fce98e593302bd74c9a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:20.725410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1267/2537] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:20 2022] DELETE /identity/v3/users/5ef60d4ff3ba4fce98e593302bd74c9a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:20.729949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:20.730493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:20.730589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:20.750402 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:20.752098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:20.804013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:20.817407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1271/2538] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:20.827913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:20.830142 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:20.900602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c1109-2f86-4d6f-a1ef-d75e5f9e4f60 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:20.904610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:20.905269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:20.905549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:20.905828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:20.917159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:20.918640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:20.930381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1268/2539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:21.229731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:21.231312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:21.244742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6dfab-3a0d-4833-abb1-7f41e1a8bf9f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:21.249351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:21.249986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:21.250302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:21.250579 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] PATH_INFO: `/v3/projects/6b0243929e4a461297d75374934cd15e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:21.251762 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0243929e4a461297d75374934cd15e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:21.253682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:21.301269 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0243929e4a461297d75374934cd15e', 'request_id': 'req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.309112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0243929e4a461297d75374934cd15e', 'request_id': 'req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.315894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0243929e4a461297d75374934cd15e', 'request_id': 'req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.326927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] The token cache is being invalidate because project 6b0243929e4a461297d75374934cd15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:21.327212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.327855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.329460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1272/2540] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:21 2022] DELETE /identity/v3/projects/6b0243929e4a461297d75374934cd15e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:21.333507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:21.343094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e1ce-2907-4af2-b567-522d1e95e36b service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:21.404527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:21.405166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:21.405445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:21.405721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] PATH_INFO: `/v3/users/ccdf05fe227c4678b005f0fb6049e12e` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:21.406880 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccdf05fe227c4678b005f0fb6049e12e)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:21.408864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:21.453385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccdf05fe227c4678b005f0fb6049e12e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.465700 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccdf05fe227c4678b005f0fb6049e12e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.473443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccdf05fe227c4678b005f0fb6049e12e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.480685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccdf05fe227c4678b005f0fb6049e12e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.481324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0d4a306f-2db6-44e6-a43e-25d7c065312b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccdf05fe227c4678b005f0fb6049e12e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.482758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:21.489118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1269/2541] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:21 2022] DELETE /identity/v3/users/ccdf05fe227c4678b005f0fb6049e12e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:21.773021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:21.774581 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:21.790225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56cd3f-4e60-4fd7-8687-29e303dc54c5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:21.868507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:21.869141 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:21.869422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:21.869694 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] PATH_INFO: `/v3/projects/b635244681b646fe975cdf7bc8640ead` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:21.870835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b635244681b646fe975cdf7bc8640ead)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:21.872740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:21.928193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b635244681b646fe975cdf7bc8640ead', 'request_id': 'req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.938753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b635244681b646fe975cdf7bc8640ead', 'request_id': 'req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.948026 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b635244681b646fe975cdf7bc8640ead', 'request_id': 'req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.962215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] The token cache is being invalidate because project b635244681b646fe975cdf7bc8640ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:21.962523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.963186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-9dace7c2-3a66-4f26-ab44-792fc4e2ad50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:21.965429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1273/2542] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:21 2022] DELETE /identity/v3/projects/b635244681b646fe975cdf7bc8640ead => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:21.971553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72dcc-8939-45c4-a82c-08179377319c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:21.972111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72dcc-8939-45c4-a82c-08179377319c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:21.972363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f72dcc-8939-45c4-a82c-08179377319c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:21.997263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-75f72dcc-8939-45c4-a82c-08179377319c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:21.998579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75f72dcc-8939-45c4-a82c-08179377319c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:22.076194 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1270/2543] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:22.084747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba179-8193-4c94-8041-686edf3542ec None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.084962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba179-8193-4c94-8041-686edf3542ec None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.085231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba179-8193-4c94-8041-686edf3542ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.107701 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bcfba179-8193-4c94-8041-686edf3542ec None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:22.108939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bcfba179-8193-4c94-8041-686edf3542ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:22.119492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1274/2544] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:22.123823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f72dcc-8939-45c4-a82c-08179377319c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.134577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f72dcc-8939-45c4-a82c-08179377319c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.139317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.139912 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.140186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.140452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.141092 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:22.142098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.143819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.155317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1271/2545] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:22.159957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba179-8193-4c94-8041-686edf3542ec None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.164442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:22.170965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba179-8193-4c94-8041-686edf3542ec None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.177440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.178044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.178360 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.178671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.179299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.181253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.210517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1275/2546] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:22 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:22.214814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.225871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456111f-b7a4-43c2-8ab6-4d7231920d0b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.286381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.286989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.287268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.287540 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.288177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.290087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.312474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1272/2547] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:22 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:22.317312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.327534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135861b-411a-4eca-9494-80540a0a8f3a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.332340 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.332938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.333213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.333483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.334119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.335750 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.346005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1276/2548] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:22.350450 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.361327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368d643-800c-4619-bf3a-52a6c907fe4f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.366856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.367478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.367871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.368152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.368797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.370426 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.382009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1273/2549] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:22.386335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.396252 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76653d86-16fb-4eea-86b5-a9e84c1ee7c3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.400804 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1661f-647a-4ac1-9d72-269511e6e2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.401439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1661f-647a-4ac1-9d72-269511e6e2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.401713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1661f-647a-4ac1-9d72-269511e6e2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.401983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1661f-647a-4ac1-9d72-269511e6e2bb admin admin] PATH_INFO: `/v3/projects/7ae6110a039d445aaa595fcfe37d463f/users/f2adb993c1a6455986b87cc47ca7f1c2/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.416903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1661f-647a-4ac1-9d72-269511e6e2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae6110a039d445aaa595fcfe37d463f, user_id=f2adb993c1a6455986b87cc47ca7f1c2, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.419599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1661f-647a-4ac1-9d72-269511e6e2bb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.422230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.424545 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:22.434172 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1277/2550] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:22 2022] PUT /identity/v3/projects/7ae6110a039d445aaa595fcfe37d463f/users/f2adb993c1a6455986b87cc47ca7f1c2/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:22.502506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05ef6-03e7-407e-916b-d42f43a8c269 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.502788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05ef6-03e7-407e-916b-d42f43a8c269 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.503058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05ef6-03e7-407e-916b-d42f43a8c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.503461 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:22.510985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c08a-bb6d-4e6e-a2e4-9b716c566758 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.532571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-3ad05ef6-03e7-407e-916b-d42f43a8c269 None None] MFA Rules not processed for user `f2adb993c1a6455986b87cc47ca7f1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:22.533809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3ad05ef6-03e7-407e-916b-d42f43a8c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:22.596262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.596826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.597114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.597640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.599472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:22.613452 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1278/2551] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:22.617832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad05ef6-03e7-407e-916b-d42f43a8c269 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.662336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.664005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.674083 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1274/2552] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:22.684564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad05ef6-03e7-407e-916b-d42f43a8c269 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.690144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.690978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.691114 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.691525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.691982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.694000 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.733879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1279/2553] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:22 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:22.737419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.749923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957801f-b3a1-48ea-ac74-a4b8f322a0d7 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.815624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.816245 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.816527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.816802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.817493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.819777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.842940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1275/2554] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:22 2022] POST /identity/v3/users => generated 307 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:22.848704 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.859709 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08260-6b14-4eff-b1ab-9df3eef92e59 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.865957 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.866624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.866907 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.867186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.867839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.869467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.881392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1280/2555] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:22.885694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.896631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37689b-4c97-4013-af17-2ae55105b125 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.901401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:22.902044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:22.902364 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:22.902633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] PATH_INFO: `/v3/projects/ca531b4421e9449e98db8e0995bff950/users/9fdb0d8f4dc34592b139397df696f288/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:22.917720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca531b4421e9449e98db8e0995bff950, user_id=9fdb0d8f4dc34592b139397df696f288, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:22.920394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:22.933357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1276/2556] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:22 2022] PUT /identity/v3/projects/ca531b4421e9449e98db8e0995bff950/users/9fdb0d8f4dc34592b139397df696f288/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:22.937444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:22.947783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718df94c-64e7-4a7f-a6d9-5098b0a2531c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:22.953011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:23.008654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560112-8192-4d46-83ab-7cb5888316ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:23.009281 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560112-8192-4d46-83ab-7cb5888316ea admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:23.009561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560112-8192-4d46-83ab-7cb5888316ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:23.009834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560112-8192-4d46-83ab-7cb5888316ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:23.010506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560112-8192-4d46-83ab-7cb5888316ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:23.012155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560112-8192-4d46-83ab-7cb5888316ea admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:23.025254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1281/2557] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:23.030839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:23.038421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:23.043063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5abdd5-49b6-484a-86be-9d07a0e1f6cf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:23.048869 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:23.049526 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:23.049803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:23.050074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] PATH_INFO: `/v3/projects/ca531b4421e9449e98db8e0995bff950/users/9fdb0d8f4dc34592b139397df696f288/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:23.052040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca531b4421e9449e98db8e0995bff950, user_id=9fdb0d8f4dc34592b139397df696f288, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:23.054736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:23.072039 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1277/2558] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:23 2022] PUT /identity/v3/projects/ca531b4421e9449e98db8e0995bff950/users/9fdb0d8f4dc34592b139397df696f288/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:23.083004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7568a-6f2c-4dc6-9e8e-479467d71a45 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:23.083339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7568a-6f2c-4dc6-9e8e-479467d71a45 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:23.083656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7568a-6f2c-4dc6-9e8e-479467d71a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:23.122441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ffe7568a-6f2c-4dc6-9e8e-479467d71a45 None None] MFA Rules not processed for user `9fdb0d8f4dc34592b139397df696f288`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:23.123950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ffe7568a-6f2c-4dc6-9e8e-479467d71a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:23.224521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1282/2559] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:23 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:23.236283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:23.238098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:23.301858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4904429-542b-4b7e-8cf9-9786f05daed2 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:23.308360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:23.309124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:23.309313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:23.309587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:23.320444 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:23.321869 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:23.331840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1278/2560] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:23 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:23.409760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7568a-6f2c-4dc6-9e8e-479467d71a45 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:23.419995 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7568a-6f2c-4dc6-9e8e-479467d71a45 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:23.423662 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774feadb-044d-46fb-a84c-1d5ef85333e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:23.424261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774feadb-044d-46fb-a84c-1d5ef85333e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:23.424534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774feadb-044d-46fb-a84c-1d5ef85333e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:23.424915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774feadb-044d-46fb-a84c-1d5ef85333e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:23.486145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774feadb-044d-46fb-a84c-1d5ef85333e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:23.487647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774feadb-044d-46fb-a84c-1d5ef85333e4 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:23.496839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1283/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:23 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:27.847662 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:27.910014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d58eb-6495-4a28-94df-d45ddfcf8797 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:27.914983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:27.915640 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:27.915923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:27.916202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] PATH_INFO: `/v3/users/f2adb993c1a6455986b87cc47ca7f1c2` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:27.917326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2adb993c1a6455986b87cc47ca7f1c2)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:27.919495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:27.977781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2adb993c1a6455986b87cc47ca7f1c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:27.989866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2adb993c1a6455986b87cc47ca7f1c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:27.997474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2adb993c1a6455986b87cc47ca7f1c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.005241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2adb993c1a6455986b87cc47ca7f1c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.005888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2adb993c1a6455986b87cc47ca7f1c2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.011756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1279/2562] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:27 2022] DELETE /identity/v3/users/f2adb993c1a6455986b87cc47ca7f1c2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:28.016384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:28.016892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:28.017009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:28.037018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:28.038220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:28.062020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:28.105878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1284/2563] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:28.116140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:28.117549 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:28.132585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:28.183377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568cf132-2196-4eaf-9a0d-6d9ee89590fb admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:28.187118 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:28.187729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:28.188006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:28.188280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:28.197919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:28.199401 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:28.210100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1280/2564] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:28.510659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:28.512458 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:28.526933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2897f-e20d-4dee-9477-da9fc8910395 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:28.532449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:28.533145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:28.533472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:28.533681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] PATH_INFO: `/v3/projects/7ae6110a039d445aaa595fcfe37d463f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:28.534884 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae6110a039d445aaa595fcfe37d463f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:28.536777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:28.586379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae6110a039d445aaa595fcfe37d463f', 'request_id': 'req-6612c332-29c3-4ae7-8e7a-138600b6734a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.596917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae6110a039d445aaa595fcfe37d463f', 'request_id': 'req-6612c332-29c3-4ae7-8e7a-138600b6734a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.609139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae6110a039d445aaa595fcfe37d463f', 'request_id': 'req-6612c332-29c3-4ae7-8e7a-138600b6734a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.622393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] The token cache is being invalidate because project 7ae6110a039d445aaa595fcfe37d463f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:28.622689 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.623379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.624948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1285/2565] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:28 2022] DELETE /identity/v3/projects/7ae6110a039d445aaa595fcfe37d463f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:28.629082 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:28.639204 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a925e9-9583-4edb-9414-00a17b765ba8 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:28.698954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:28.699594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:28.699874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:28.700712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] PATH_INFO: `/v3/users/9fdb0d8f4dc34592b139397df696f288` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:28.701440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdb0d8f4dc34592b139397df696f288)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:28.703560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:28.755497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdb0d8f4dc34592b139397df696f288'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.774013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdb0d8f4dc34592b139397df696f288'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.781908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdb0d8f4dc34592b139397df696f288'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.790059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdb0d8f4dc34592b139397df696f288'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.790795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8f112acd-3afc-4268-a5fe-932f856cbd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdb0d8f4dc34592b139397df696f288'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:28.796676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1281/2566] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:28 2022] DELETE /identity/v3/users/9fdb0d8f4dc34592b139397df696f288 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:29.072094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.073626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:29.089149 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612c332-29c3-4ae7-8e7a-138600b6734a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.148502 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.149050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.149331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.149605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] PATH_INFO: `/v3/projects/ca531b4421e9449e98db8e0995bff950` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.150752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca531b4421e9449e98db8e0995bff950)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:29.152671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:29.199218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca531b4421e9449e98db8e0995bff950', 'request_id': 'req-41bd5a7d-77b3-452d-9133-d7cfcd29746a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:29.202780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:29.207728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca531b4421e9449e98db8e0995bff950', 'request_id': 'req-41bd5a7d-77b3-452d-9133-d7cfcd29746a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:29.214631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca531b4421e9449e98db8e0995bff950', 'request_id': 'req-41bd5a7d-77b3-452d-9133-d7cfcd29746a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:29.225688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] The token cache is being invalidate because project ca531b4421e9449e98db8e0995bff950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:29.225970 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:29.226617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-41bd5a7d-77b3-452d-9133-d7cfcd29746a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:29.228200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1286/2567] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:29 2022] DELETE /identity/v3/projects/ca531b4421e9449e98db8e0995bff950 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:29.232881 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990400b-52f0-4451-ba18-0038d3301b54 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.233341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990400b-52f0-4451-ba18-0038d3301b54 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.233460 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990400b-52f0-4451-ba18-0038d3301b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.254427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a990400b-52f0-4451-ba18-0038d3301b54 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:29.255636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a990400b-52f0-4451-ba18-0038d3301b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:29.289984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:29.328336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1282/2568] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:29.337364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41bd1-953f-4989-81b6-1ec39822054b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.337654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41bd1-953f-4989-81b6-1ec39822054b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.337920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41bd1-953f-4989-81b6-1ec39822054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.359400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e2d41bd1-953f-4989-81b6-1ec39822054b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:29.360693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e2d41bd1-953f-4989-81b6-1ec39822054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:29.373236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1287/2569] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:29.377850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990400b-52f0-4451-ba18-0038d3301b54 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.390751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990400b-52f0-4451-ba18-0038d3301b54 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.396513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.397124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.397400 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.397671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.398355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:29.398713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:29.400269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:29.418852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1283/2570] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:29.421054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d41bd1-953f-4989-81b6-1ec39822054b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.437368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d41bd1-953f-4989-81b6-1ec39822054b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.446657 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.448501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.448501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.448501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.448843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:29.451338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:29.488078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1288/2571] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:29 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:29.501543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.519469 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16db43-f999-4473-9d25-4d5db4143170 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.584388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.584997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.585274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.585541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.586287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:29.588632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:29.616993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1284/2572] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:29 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:29.619723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.636359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8bc8b-da68-45a6-aba9-93ea3a815a34 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.641436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.642287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.643013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.643013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.643761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:29.645429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:29.668201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1289/2573] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:28:29.670021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.684922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a93959-c3d1-4e4b-a900-41c6e595ffad admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.690097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2138fb-ffe4-4744-8119-f0c4d9360eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.690752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2138fb-ffe4-4744-8119-f0c4d9360eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.691036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2138fb-ffe4-4744-8119-f0c4d9360eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.691459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2138fb-ffe4-4744-8119-f0c4d9360eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.692128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2138fb-ffe4-4744-8119-f0c4d9360eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:29.693732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2138fb-ffe4-4744-8119-f0c4d9360eaf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:29.711607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1285/2574] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:29.713036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.725550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e27a4-4b6f-445a-97ad-70b52045da9a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.730619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.731284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.731563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.731862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] PATH_INFO: `/v3/projects/3f5212c347ff4e71852df7e303ad9971/users/b4d3ee85e7364602b6c6af6780a40850/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.750039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5212c347ff4e71852df7e303ad9971, user_id=b4d3ee85e7364602b6c6af6780a40850, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:29.752609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:29.768489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1290/2575] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:29 2022] PUT /identity/v3/projects/3f5212c347ff4e71852df7e303ad9971/users/b4d3ee85e7364602b6c6af6780a40850/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:29.779016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.779275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.779561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:29.821991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] MFA Rules not processed for user `b4d3ee85e7364602b6c6af6780a40850`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:29.823794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:29.916923 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1286/2576] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:29.929081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:29.930930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:29.991984 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04a203-79f1-4317-9a1e-7eeba188bf1e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:29.996019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6be9fd-94df-4e33-801e-52532aeb2b0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:29.996667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6be9fd-94df-4e33-801e-52532aeb2b0e service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:29.996956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6be9fd-94df-4e33-801e-52532aeb2b0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:29.997230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6be9fd-94df-4e33-801e-52532aeb2b0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:30.006754 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6be9fd-94df-4e33-801e-52532aeb2b0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:30.008203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6be9fd-94df-4e33-801e-52532aeb2b0e service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:30.019008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1291/2577] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:32.031284 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:32.034016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:32.075720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:32.116794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac348e-b12f-460a-b122-492a41c45738 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:32.121706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:32.122387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:32.122670 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:32.122950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] PATH_INFO: `/v3/users/59c6df8447924cb4a581fb7a76c29eea` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:32.124307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c6df8447924cb4a581fb7a76c29eea)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:32.128087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:32.203978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c6df8447924cb4a581fb7a76c29eea'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.216821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c6df8447924cb4a581fb7a76c29eea'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.225731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c6df8447924cb4a581fb7a76c29eea'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.234984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c6df8447924cb4a581fb7a76c29eea'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.236225 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c6df8447924cb4a581fb7a76c29eea'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.242721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1287/2578] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:32 2022] DELETE /identity/v3/users/59c6df8447924cb4a581fb7a76c29eea => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:32.247460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:32.248001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:32.248001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:32.268700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:32.269922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:32.351742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1292/2579] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:32.362372 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:32.363989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:32.433982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425732b-e813-41ec-8a30-7aa7cce8cc8f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:32.437985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:32.438649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:32.439520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:32.440440 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:32.450840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:32.452327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:32.465079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1288/2580] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:32.801559 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:32.803654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:32.818607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d246b84-4e48-42de-a3a1-c7ded2e98026 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:32.835604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:32.837561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:32.838192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:32.838584 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] PATH_INFO: `/v3/projects/750b9f1e81d54f1b9129e9133aea86e9` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:32.840992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750b9f1e81d54f1b9129e9133aea86e9)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:32.845954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:32.872130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:32.912042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750b9f1e81d54f1b9129e9133aea86e9', 'request_id': 'req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.921745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750b9f1e81d54f1b9129e9133aea86e9', 'request_id': 'req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.929685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750b9f1e81d54f1b9129e9133aea86e9', 'request_id': 'req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.941816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] The token cache is being invalidate because project 750b9f1e81d54f1b9129e9133aea86e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:32.942102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.942812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:32.944343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1293/2581] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:32 2022] DELETE /identity/v3/projects/750b9f1e81d54f1b9129e9133aea86e9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:32.948497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:32.959608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857df30d-b9b0-4028-aa80-bc2fd4b8bb99 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:33.012738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:33.025478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:33.026263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:33.026556 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:33.026840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] PATH_INFO: `/v3/users/2e014b7fcfab4ab7b0e6ba979337b2f0` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:33.028137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e014b7fcfab4ab7b0e6ba979337b2f0)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:33.030102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:33.084360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e014b7fcfab4ab7b0e6ba979337b2f0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.098714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e014b7fcfab4ab7b0e6ba979337b2f0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.106868 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e014b7fcfab4ab7b0e6ba979337b2f0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.114966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e014b7fcfab4ab7b0e6ba979337b2f0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.115688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ea723a88-cbd4-4a8f-8a30-304b91494051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e014b7fcfab4ab7b0e6ba979337b2f0'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.122386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1289/2582] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:32 2022] DELETE /identity/v3/users/2e014b7fcfab4ab7b0e6ba979337b2f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:33.498635 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:33.500488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:33.519645 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f55f9-dc64-4dfe-b12e-bba0b48da9b5 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:33.601163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:33.601917 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:33.602203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:33.602504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] PATH_INFO: `/v3/projects/c339c9b1f15548a4ba6eee843d42dbad` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:33.603686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c339c9b1f15548a4ba6eee843d42dbad)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:33.605636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:33.668524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c339c9b1f15548a4ba6eee843d42dbad', 'request_id': 'req-7c15840c-b314-49df-a52c-982a501deb80'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.680875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c339c9b1f15548a4ba6eee843d42dbad', 'request_id': 'req-7c15840c-b314-49df-a52c-982a501deb80'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.689529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c339c9b1f15548a4ba6eee843d42dbad', 'request_id': 'req-7c15840c-b314-49df-a52c-982a501deb80'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.701169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] The token cache is being invalidate because project c339c9b1f15548a4ba6eee843d42dbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:33.701475 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.702171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7c15840c-b314-49df-a52c-982a501deb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:33.703779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1294/2583] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:33 2022] DELETE /identity/v3/projects/c339c9b1f15548a4ba6eee843d42dbad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:33.709280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb137-1a41-4f27-8e9d-06ed4fc873d4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:33.709567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb137-1a41-4f27-8e9d-06ed4fc873d4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:33.709840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fb137-1a41-4f27-8e9d-06ed4fc873d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:33.738678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-952fb137-1a41-4f27-8e9d-06ed4fc873d4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:33.740806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-952fb137-1a41-4f27-8e9d-06ed4fc873d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:33.815628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1290/2584] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:33.823384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb73a9-bff3-4f48-9acf-cc0991526594 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:33.823672 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb73a9-bff3-4f48-9acf-cc0991526594 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:33.823943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb73a9-bff3-4f48-9acf-cc0991526594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:33.844952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c8eb73a9-bff3-4f48-9acf-cc0991526594 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:33.846706 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c8eb73a9-bff3-4f48-9acf-cc0991526594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:33.856262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1295/2585] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:33.861425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb137-1a41-4f27-8e9d-06ed4fc873d4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:33.871609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fb137-1a41-4f27-8e9d-06ed4fc873d4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:33.877798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:33.878491 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:33.878782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:33.879065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:33.879745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:33.880052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:33.881768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:33.897966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1291/2586] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:33.902655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb73a9-bff3-4f48-9acf-cc0991526594 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:33.914830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb73a9-bff3-4f48-9acf-cc0991526594 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:33.920988 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:33.921615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:33.921895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:33.922192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:33.924611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:33.927376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:33.964963 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1296/2587] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:33 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:33.969447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:33.982735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf79ac-5474-4485-9249-2cc6922d82b3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.064186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.065024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.065591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.065991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.066990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.069889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.080664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:34.103026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1292/2588] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:33 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:34.106698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.128444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde18c-c660-4f4b-86ce-357a5f0744e3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.134123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.134836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.135116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.135385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.136047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.137697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.139541 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:34.155896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1297/2589] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:34.157126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.168327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4d362-90c5-4a2d-ab1c-d291899a3863 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.174359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14d4c6-b109-404c-add1-a3a2a62171f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.175114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d4c6-b109-404c-add1-a3a2a62171f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.175562 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d4c6-b109-404c-add1-a3a2a62171f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.175894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d4c6-b109-404c-add1-a3a2a62171f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.176606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14d4c6-b109-404c-add1-a3a2a62171f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.178412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14d4c6-b109-404c-add1-a3a2a62171f3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.192037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1293/2590] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:34.196711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.208468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b434b9-342b-418f-8dcb-d841a19f6b4d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.213354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.214060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.214378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.214655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] PATH_INFO: `/v3/projects/bf242f5249db405681e475dd22140b45/users/20f05f0d477e42d7a140d17d67725c19/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.231681 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf242f5249db405681e475dd22140b45, user_id=20f05f0d477e42d7a140d17d67725c19, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.234479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.251071 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1298/2591] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:34 2022] PUT /identity/v3/projects/bf242f5249db405681e475dd22140b45/users/20f05f0d477e42d7a140d17d67725c19/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:34.264488 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107df453-db20-4567-91a9-17c63561b364 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.264909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107df453-db20-4567-91a9-17c63561b364 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.265234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107df453-db20-4567-91a9-17c63561b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.306302 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-107df453-db20-4567-91a9-17c63561b364 None None] MFA Rules not processed for user `20f05f0d477e42d7a140d17d67725c19`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:34.308744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-107df453-db20-4567-91a9-17c63561b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:34.454572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1294/2592] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:34.459376 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.530107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e728cd-3390-414b-b63a-6d32199dd4c4 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.536028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.536711 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.536989 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.537265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.537958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.540003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.576985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1299/2593] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:34 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:34.581585 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107df453-db20-4567-91a9-17c63561b364 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.594819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107df453-db20-4567-91a9-17c63561b364 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.664864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.665430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.665713 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.665988 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.666707 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.668874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.692810 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1295/2594] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:34 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:34.696996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.710478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9f79-1659-4b14-b973-eb4277aff579 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.716329 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.717069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.717460 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.717840 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.718760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.721998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.734451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1300/2595] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:34.739850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.751432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82be09a-14ef-4481-8c08-6ecdf5a16f1a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.756905 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9a5bc-767a-441b-8e73-62e2e683f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.757666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a5bc-767a-441b-8e73-62e2e683f777 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.757948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a5bc-767a-441b-8e73-62e2e683f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.758218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9a5bc-767a-441b-8e73-62e2e683f777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.759052 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9a5bc-767a-441b-8e73-62e2e683f777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.761006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9a5bc-767a-441b-8e73-62e2e683f777 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.773805 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1296/2596] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:34.778163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:34.789437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b537f-406c-45e5-a49f-6fb92c2bb62b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:34.794405 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:34.795083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.795362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.795637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] PATH_INFO: `/v3/projects/516e473b1be2428fb6a4921c786a47f0/users/95186e3dd59748168253d788a79952dd/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.814849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516e473b1be2428fb6a4921c786a47f0, user_id=95186e3dd59748168253d788a79952dd, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:34.817556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:34.834852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1301/2597] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:34 2022] PUT /identity/v3/projects/516e473b1be2428fb6a4921c786a47f0/users/95186e3dd59748168253d788a79952dd/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:34.847064 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea4a52-1d59-42bf-829e-4d261b0f2110 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:34.847861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea4a52-1d59-42bf-829e-4d261b0f2110 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:34.848383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea4a52-1d59-42bf-829e-4d261b0f2110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:34.882763 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-92ea4a52-1d59-42bf-829e-4d261b0f2110 None None] MFA Rules not processed for user `95186e3dd59748168253d788a79952dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:34.884041 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-92ea4a52-1d59-42bf-829e-4d261b0f2110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:34.924646 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:34.963116 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1297/2598] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:34.968166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.056845 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc59fa-436e-4aed-ba19-596b679c5799 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.062664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.063309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.063591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.064037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.064984 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:35.070075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:35.109014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1302/2599] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:34 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:35.113978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea4a52-1d59-42bf-829e-4d261b0f2110 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.127632 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea4a52-1d59-42bf-829e-4d261b0f2110 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.209893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.210903 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.211369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.211746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.212818 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:35.216251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:35.250330 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1298/2600] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:35 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:35.253999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.267924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5d8bc-e8d9-4abb-8265-7b31fec37d7c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.273159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.273881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.274170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.274488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.275152 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:35.276819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:35.278615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:35.302797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1303/2601] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:35.308330 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.323222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e94d7-8615-4734-a8a0-c233d454808a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.330908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.331495 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.331773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.332059 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] PATH_INFO: `/v3/projects/6fccbea19cb74a6fa0939d649959288d/users/4a8dad4d36a249f2876d72a9bea58c39/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.352273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fccbea19cb74a6fa0939d649959288d, user_id=4a8dad4d36a249f2876d72a9bea58c39, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:35.355351 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:35.377748 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1299/2602] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:35 2022] PUT /identity/v3/projects/6fccbea19cb74a6fa0939d649959288d/users/4a8dad4d36a249f2876d72a9bea58c39/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:35.384042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.398074 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e54fe-d96a-439c-ac65-b23b00c52d33 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.487083 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71d624-9e41-4b2d-a357-3b2a21e06842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.488036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d624-9e41-4b2d-a357-3b2a21e06842 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.488489 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d624-9e41-4b2d-a357-3b2a21e06842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.489229 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71d624-9e41-4b2d-a357-3b2a21e06842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.490064 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71d624-9e41-4b2d-a357-3b2a21e06842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:35.492184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71d624-9e41-4b2d-a357-3b2a21e06842 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:35.510772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1304/2603] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:35.516034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.531067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44341b39-c675-4886-8284-c020f72c9c9b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.554709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.555527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.555825 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.556107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] PATH_INFO: `/v3/projects/6fccbea19cb74a6fa0939d649959288d/users/4a8dad4d36a249f2876d72a9bea58c39/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.559942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fccbea19cb74a6fa0939d649959288d, user_id=4a8dad4d36a249f2876d72a9bea58c39, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:35.564100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:35.580246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1300/2604] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:35 2022] PUT /identity/v3/projects/6fccbea19cb74a6fa0939d649959288d/users/4a8dad4d36a249f2876d72a9bea58c39/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:35.593697 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.594182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.594603 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.644228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] MFA Rules not processed for user `4a8dad4d36a249f2876d72a9bea58c39`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:35.645658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:35.749723 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1305/2605] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:28:35.763899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.767769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:35.867044 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f6c2f-6bed-4f7c-ad3e-6780bf8f7736 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.871123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.871757 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.872035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.872309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:35.882678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:35.884131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:35.895501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1301/2606] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:35.944821 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:35.946390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:35.960383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fa6be-1131-469f-82d8-f4e5bcf32470 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:35.964322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a6c5c-1524-400b-b751-af39180c38b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:35.964949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6c5c-1524-400b-b751-af39180c38b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:35.965243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6c5c-1524-400b-b751-af39180c38b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:35.965513 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a6c5c-1524-400b-b751-af39180c38b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:36.033789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a6c5c-1524-400b-b751-af39180c38b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:36.035997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a6c5c-1524-400b-b751-af39180c38b9 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:36.046736 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1306/2607] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:39.167014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.202012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:39.238305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1af4b4-940c-4c12-88e5-8420d7ffe180 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.243342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.243982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.244267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.244539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] PATH_INFO: `/v3/users/20f05f0d477e42d7a140d17d67725c19` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.245701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f05f0d477e42d7a140d17d67725c19)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.247708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.301390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f05f0d477e42d7a140d17d67725c19'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:39.314822 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f05f0d477e42d7a140d17d67725c19'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:39.324075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f05f0d477e42d7a140d17d67725c19'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:39.333100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f05f0d477e42d7a140d17d67725c19'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:39.333759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f05f0d477e42d7a140d17d67725c19'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:39.340054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1302/2608] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:39 2022] DELETE /identity/v3/users/20f05f0d477e42d7a140d17d67725c19 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:39.345947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.346550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.346986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.378842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:39.380955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.396901 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:39.470069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1307/2609] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:39.483443 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.485308 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.574320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112def9-8b50-4d21-a9fe-09f36e804c1d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.579321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.580228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:39.580592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:39.580865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:39.593700 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:39.595500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:39.610045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1303/2610] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:39.973331 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:39.974905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:39.990718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3fc8f-77d8-42e8-816c-30d24c94450f None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:39.998334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:39.999408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.000001 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.000448 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] PATH_INFO: `/v3/projects/bf242f5249db405681e475dd22140b45` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.002773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf242f5249db405681e475dd22140b45)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.005276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:40.071663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf242f5249db405681e475dd22140b45', 'request_id': 'req-46ba3bf3-5c53-456d-92f6-4647a22ebec3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.080345 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf242f5249db405681e475dd22140b45', 'request_id': 'req-46ba3bf3-5c53-456d-92f6-4647a22ebec3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.088200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf242f5249db405681e475dd22140b45', 'request_id': 'req-46ba3bf3-5c53-456d-92f6-4647a22ebec3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.116615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] The token cache is being invalidate because project bf242f5249db405681e475dd22140b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:40.117487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.118524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.120767 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1308/2611] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:39 2022] DELETE /identity/v3/projects/bf242f5249db405681e475dd22140b45 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:40.125685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:40.136615 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc5bfc-558e-461e-b759-fb0103833d6a service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:40.193933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:40.205598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:40.206376 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.206840 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.207342 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] PATH_INFO: `/v3/users/95186e3dd59748168253d788a79952dd` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.208575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95186e3dd59748168253d788a79952dd)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.210664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:40.268501 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95186e3dd59748168253d788a79952dd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.284231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95186e3dd59748168253d788a79952dd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.293172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95186e3dd59748168253d788a79952dd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.303439 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95186e3dd59748168253d788a79952dd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.304176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95186e3dd59748168253d788a79952dd'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.310564 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1304/2612] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:40 2022] DELETE /identity/v3/users/95186e3dd59748168253d788a79952dd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:40.615545 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:40.617066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:40.631844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba3bf3-5c53-456d-92f6-4647a22ebec3 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:40.699867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:40.700427 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.700703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.700977 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] PATH_INFO: `/v3/projects/516e473b1be2428fb6a4921c786a47f0` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.702187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=516e473b1be2428fb6a4921c786a47f0)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.704268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:40.753341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:40.762015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516e473b1be2428fb6a4921c786a47f0', 'request_id': 'req-899bad6b-3574-4eda-bbec-d57f43e9b95c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.772882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516e473b1be2428fb6a4921c786a47f0', 'request_id': 'req-899bad6b-3574-4eda-bbec-d57f43e9b95c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.785971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516e473b1be2428fb6a4921c786a47f0', 'request_id': 'req-899bad6b-3574-4eda-bbec-d57f43e9b95c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.808607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] The token cache is being invalidate because project 516e473b1be2428fb6a4921c786a47f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:40.808939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.814933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:40.816878 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1309/2613] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:40 2022] DELETE /identity/v3/projects/516e473b1be2428fb6a4921c786a47f0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:40.821155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:40.823246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:40.837768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d38b-7811-4a04-b2a5-e03bdf1dcfe8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:40.927893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:40.928856 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:40.929314 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:40.929826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] PATH_INFO: `/v3/users/4a8dad4d36a249f2876d72a9bea58c39` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:40.931694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8dad4d36a249f2876d72a9bea58c39)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:40.935213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.006702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8dad4d36a249f2876d72a9bea58c39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.031991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8dad4d36a249f2876d72a9bea58c39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.043012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8dad4d36a249f2876d72a9bea58c39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.046628 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:41.056408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8dad4d36a249f2876d72a9bea58c39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.058895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-e9222173-6410-476e-b377-7f4c655d3ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8dad4d36a249f2876d72a9bea58c39'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.071128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1305/2614] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:40 2022] DELETE /identity/v3/users/4a8dad4d36a249f2876d72a9bea58c39 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:41.420125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.421881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:41.445467 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bad6b-3574-4eda-bbec-d57f43e9b95c admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.528232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.528936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.529222 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.529483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] PATH_INFO: `/v3/projects/6fccbea19cb74a6fa0939d649959288d` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.530728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fccbea19cb74a6fa0939d649959288d)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.533245 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.590107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fccbea19cb74a6fa0939d649959288d', 'request_id': 'req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.601105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fccbea19cb74a6fa0939d649959288d', 'request_id': 'req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.614363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fccbea19cb74a6fa0939d649959288d', 'request_id': 'req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.628194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] The token cache is being invalidate because project 6fccbea19cb74a6fa0939d649959288d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:41.628846 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.629575 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-4c9c150c-b5b2-4e46-acd7-b51f7adabee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:41.632501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1310/2615] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:41 2022] DELETE /identity/v3/projects/6fccbea19cb74a6fa0939d649959288d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:41.639406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545717-bd28-434c-a1c9-e3e78ffec741 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.639991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545717-bd28-434c-a1c9-e3e78ffec741 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.639991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2545717-bd28-434c-a1c9-e3e78ffec741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.661930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b2545717-bd28-434c-a1c9-e3e78ffec741 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:41.663219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b2545717-bd28-434c-a1c9-e3e78ffec741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:41.744030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1306/2616] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:41.762516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d9ea4-2411-4808-b4c7-8d89e48008d8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.762914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d9ea4-2411-4808-b4c7-8d89e48008d8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.763261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d9ea4-2411-4808-b4c7-8d89e48008d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.787049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-432d9ea4-2411-4808-b4c7-8d89e48008d8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:41.788267 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-432d9ea4-2411-4808-b4c7-8d89e48008d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:41.796495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1311/2617] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:41.802873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545717-bd28-434c-a1c9-e3e78ffec741 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.814543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2545717-bd28-434c-a1c9-e3e78ffec741 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.820160 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620de315-32c5-4572-a974-91604452032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.820795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620de315-32c5-4572-a974-91604452032c admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.821075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620de315-32c5-4572-a974-91604452032c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.821353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620de315-32c5-4572-a974-91604452032c admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.822024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620de315-32c5-4572-a974-91604452032c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:41.822360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620de315-32c5-4572-a974-91604452032c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.824006 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620de315-32c5-4572-a974-91604452032c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.844669 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1307/2618] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:41.847820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d9ea4-2411-4808-b4c7-8d89e48008d8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.865437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d9ea4-2411-4808-b4c7-8d89e48008d8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.873733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.874806 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.875306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.875864 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.876971 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.879409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:41.912038 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1312/2619] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:41 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:41.916452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620de315-32c5-4572-a974-91604452032c admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:41.927577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620de315-32c5-4572-a974-91604452032c admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:41.988437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:41.989047 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:41.989327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:41.989601 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:41.990310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:41.992240 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.015069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1308/2620] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:41 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:42.020065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.031110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a397e-d384-4067-a0ee-f47ea070f9ee admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.037371 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.038065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.038514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.038926 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.039669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.041521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.053406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1313/2621] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:42.057558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.069708 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745674bc-3c94-49b7-ace1-01747805f750 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.074703 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5999f-7769-47db-9b48-ead414d1acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.075321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5999f-7769-47db-9b48-ead414d1acca admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.075598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5999f-7769-47db-9b48-ead414d1acca admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.075870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5999f-7769-47db-9b48-ead414d1acca admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.076536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5999f-7769-47db-9b48-ead414d1acca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.078159 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5999f-7769-47db-9b48-ead414d1acca admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.091192 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1309/2622] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:42.096470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.107664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4fdf7-3442-4573-b491-9052349fb649 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.114011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.114739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.115022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.115299 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] PATH_INFO: `/v3/projects/11151fa854ec4c43b4d85daa62ee24c5/users/1ad12ebe43e442b7af9ceb0b3f6835a7/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.132592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=11151fa854ec4c43b4d85daa62ee24c5, user_id=1ad12ebe43e442b7af9ceb0b3f6835a7, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.135375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.139125 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:42.154305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1314/2623] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:42 2022] PUT /identity/v3/projects/11151fa854ec4c43b4d85daa62ee24c5/users/1ad12ebe43e442b7af9ceb0b3f6835a7/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:42.167800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.168393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.168895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.216968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] MFA Rules not processed for user `1ad12ebe43e442b7af9ceb0b3f6835a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:42.219463 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.302133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.304288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.317377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:42.358150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1310/2624] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:42.366854 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.368384 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.403323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c26e-43e1-4fcb-8ced-3f12e14e8edc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.409468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.410425 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.410707 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.410979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] PATH_INFO: `/v3/users/b4d3ee85e7364602b6c6af6780a40850` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.412439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d3ee85e7364602b6c6af6780a40850)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.416092 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.437262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8e63-719d-4123-8e77-522e4399b28d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.441992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd94a-c0db-4d48-94dd-88b27fc5196b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.442645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd94a-c0db-4d48-94dd-88b27fc5196b service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.442968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd94a-c0db-4d48-94dd-88b27fc5196b service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.443267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd94a-c0db-4d48-94dd-88b27fc5196b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.452847 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd94a-c0db-4d48-94dd-88b27fc5196b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.455301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd94a-c0db-4d48-94dd-88b27fc5196b service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.465535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1311/2625] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:28:42.474890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d3ee85e7364602b6c6af6780a40850'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.492747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d3ee85e7364602b6c6af6780a40850'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.505016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d3ee85e7364602b6c6af6780a40850'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.506073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d3ee85e7364602b6c6af6780a40850'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.516332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d3ee85e7364602b6c6af6780a40850'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:42.524247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1315/2626] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:42 2022] DELETE /identity/v3/users/b4d3ee85e7364602b6c6af6780a40850 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:42.528910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.529269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.529567 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.552709 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:42.553957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.644187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1312/2627] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:42.655107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:42.656628 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:42.743520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ff5a5-5c80-4675-b18e-1a090b076cdc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:42.748276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba0fc0-f5ca-4aa5-8439-5cde24982123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:42.749206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba0fc0-f5ca-4aa5-8439-5cde24982123 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:42.749604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba0fc0-f5ca-4aa5-8439-5cde24982123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:42.749931 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba0fc0-f5ca-4aa5-8439-5cde24982123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:42.763623 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba0fc0-f5ca-4aa5-8439-5cde24982123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:42.766206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba0fc0-f5ca-4aa5-8439-5cde24982123 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:42.778601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1316/2628] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:43.181206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.182772 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.195747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c697-ea3e-4166-b591-fc2109ff9d60 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.203928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.205252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.205533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.205948 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] PATH_INFO: `/v3/projects/3f5212c347ff4e71852df7e303ad9971` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.207113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5212c347ff4e71852df7e303ad9971)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.209438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.266193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5212c347ff4e71852df7e303ad9971', 'request_id': 'req-72e44064-cf5b-443d-8241-e1907c4107d4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:43.275281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5212c347ff4e71852df7e303ad9971', 'request_id': 'req-72e44064-cf5b-443d-8241-e1907c4107d4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:43.283242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5212c347ff4e71852df7e303ad9971', 'request_id': 'req-72e44064-cf5b-443d-8241-e1907c4107d4'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:43.295870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] The token cache is being invalidate because project 3f5212c347ff4e71852df7e303ad9971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:43.296165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:43.296838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-72e44064-cf5b-443d-8241-e1907c4107d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:43.299682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1313/2629] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:43 2022] DELETE /identity/v3/projects/3f5212c347ff4e71852df7e303ad9971 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:43.306225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc130-ce7a-4703-855e-fd19dde05de8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.306604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc130-ce7a-4703-855e-fd19dde05de8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.307090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbc130-ce7a-4703-855e-fd19dde05de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.335219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c2fbc130-ce7a-4703-855e-fd19dde05de8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:43.336468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c2fbc130-ce7a-4703-855e-fd19dde05de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.349826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:43.425522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1317/2630] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:43.433971 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0fb23-1256-4218-a164-d326bb712e1a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.434318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0fb23-1256-4218-a164-d326bb712e1a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.434775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0fb23-1256-4218-a164-d326bb712e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.471161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-35b0fb23-1256-4218-a164-d326bb712e1a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:43.472900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-35b0fb23-1256-4218-a164-d326bb712e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.481936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1314/2631] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:43.487005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbc130-ce7a-4703-855e-fd19dde05de8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.497342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbc130-ce7a-4703-855e-fd19dde05de8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.502885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.503507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.503785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.504054 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.504713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:43.505014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.506670 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.522730 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1318/2632] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:43.527200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0fb23-1256-4218-a164-d326bb712e1a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.538030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0fb23-1256-4218-a164-d326bb712e1a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.542771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.543402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.543685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.543962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.544623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.546598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.551622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:43.588741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1315/2633] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:43.589968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.601893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a113bd4-11a5-4f43-bb45-4d70d0325c5d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.665191 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.665898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.666115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.666417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.667129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.669127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.693677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1319/2634] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:43.698165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.709040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654c0d4-5f13-412f-8e81-0f8380343eb6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.714387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.715110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.715497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.715898 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.716982 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.719203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.730959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1316/2635] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:43.735244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.747506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29fb1-6e1e-4515-aff9-85394b9fbda0 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.753302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f26d1b-bf64-48cf-b0a0-1ea8b49be2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.753920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26d1b-bf64-48cf-b0a0-1ea8b49be2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.754201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26d1b-bf64-48cf-b0a0-1ea8b49be2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.754511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f26d1b-bf64-48cf-b0a0-1ea8b49be2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.755160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f26d1b-bf64-48cf-b0a0-1ea8b49be2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.756774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f26d1b-bf64-48cf-b0a0-1ea8b49be2eb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.768837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1320/2636] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:43.773390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.784333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210eea7-ca89-4025-bf44-73be1fc326ad admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:43.791839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:43.792927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.793396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.793890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] PATH_INFO: `/v3/projects/0841243863624c85ae9fc76f565df496/users/7b9d1d5b4d4041b0b7b31a3462f97b73/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.819974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0841243863624c85ae9fc76f565df496, user_id=7b9d1d5b4d4041b0b7b31a3462f97b73, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:43.822808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:43.838762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1317/2637] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:43 2022] PUT /identity/v3/projects/0841243863624c85ae9fc76f565df496/users/7b9d1d5b4d4041b0b7b31a3462f97b73/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:43.851015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:43.851434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:43.851902 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:43.884424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] MFA Rules not processed for user `7b9d1d5b4d4041b0b7b31a3462f97b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:43.885646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:43.971745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1321/2638] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:43.984251 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:43.987179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:44.058693 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b1f97-b823-493d-9df5-ac672451228d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:44.067089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c86a9c-f7e0-45da-8f72-8c6cd3a2ecb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:44.068050 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c86a9c-f7e0-45da-8f72-8c6cd3a2ecb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:44.069386 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c86a9c-f7e0-45da-8f72-8c6cd3a2ecb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:44.070177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c86a9c-f7e0-45da-8f72-8c6cd3a2ecb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:44.085176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c86a9c-f7e0-45da-8f72-8c6cd3a2ecb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:44.089981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c86a9c-f7e0-45da-8f72-8c6cd3a2ecb5 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:44.107986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1318/2639] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:48.196817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:48.198258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:48.212429 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:48.265905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01a89-91b3-4d77-9a77-dbe3a71f4ac8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:48.270479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:48.271100 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:48.271374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:48.271640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] PATH_INFO: `/v3/users/1ad12ebe43e442b7af9ceb0b3f6835a7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:48.272777 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad12ebe43e442b7af9ceb0b3f6835a7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:48.274717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:48.322404 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad12ebe43e442b7af9ceb0b3f6835a7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.334522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad12ebe43e442b7af9ceb0b3f6835a7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.341724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad12ebe43e442b7af9ceb0b3f6835a7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.342486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad12ebe43e442b7af9ceb0b3f6835a7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.351129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad12ebe43e442b7af9ceb0b3f6835a7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.357294 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1322/2640] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:48 2022] DELETE /identity/v3/users/1ad12ebe43e442b7af9ceb0b3f6835a7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:48.362521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:48.363012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:48.363123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:48.382927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:48.384132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:48.444079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1319/2641] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:48.454051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:48.455858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:48.519958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa110a-650c-48e5-a868-7e4a01381e97 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:48.523823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97600115-40ad-4db0-98a9-565f7f397e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:48.524470 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600115-40ad-4db0-98a9-565f7f397e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:48.524734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600115-40ad-4db0-98a9-565f7f397e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:48.525003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600115-40ad-4db0-98a9-565f7f397e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:48.535155 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97600115-40ad-4db0-98a9-565f7f397e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:48.536879 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97600115-40ad-4db0-98a9-565f7f397e13 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:48.548788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1323/2642] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:48.855820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:48.857387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:48.870728 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47059cae-cbf0-4cb5-929a-2f55e62bc854 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:48.876180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:48.877811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:48.878088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:48.878397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] PATH_INFO: `/v3/projects/11151fa854ec4c43b4d85daa62ee24c5` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:48.879688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] RBAC: Authorizing `identity:delete_project(project_id=11151fa854ec4c43b4d85daa62ee24c5)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:48.881798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:48.928149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:48.929399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11151fa854ec4c43b4d85daa62ee24c5', 'request_id': 'req-91cd4939-d846-496a-89d6-a6b6893a56df'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.937432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11151fa854ec4c43b4d85daa62ee24c5', 'request_id': 'req-91cd4939-d846-496a-89d6-a6b6893a56df'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.944857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11151fa854ec4c43b4d85daa62ee24c5', 'request_id': 'req-91cd4939-d846-496a-89d6-a6b6893a56df'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.955954 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] The token cache is being invalidate because project 11151fa854ec4c43b4d85daa62ee24c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:48.956238 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.956886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-91cd4939-d846-496a-89d6-a6b6893a56df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:48.958390 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1320/2643] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:48 2022] DELETE /identity/v3/projects/11151fa854ec4c43b4d85daa62ee24c5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:48.963399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180916ca-e686-4eea-9822-2421b12ba00c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:48.963685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180916ca-e686-4eea-9822-2421b12ba00c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:48.963960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180916ca-e686-4eea-9822-2421b12ba00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:48.983958 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-180916ca-e686-4eea-9822-2421b12ba00c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:48.985167 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-180916ca-e686-4eea-9822-2421b12ba00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:49.015227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:49.046085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1324/2644] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:49.054003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fabc4-ad63-4d46-87dc-383b828c5a7b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.054478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fabc4-ad63-4d46-87dc-383b828c5a7b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.054836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fabc4-ad63-4d46-87dc-383b828c5a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.076156 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bd4fabc4-ad63-4d46-87dc-383b828c5a7b None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:49.077396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bd4fabc4-ad63-4d46-87dc-383b828c5a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:49.087008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1321/2645] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:49.092727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180916ca-e686-4eea-9822-2421b12ba00c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:49.108797 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180916ca-e686-4eea-9822-2421b12ba00c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:49.113511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:49.114131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.114438 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.114712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.115397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:49.115699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:49.117305 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:49.130312 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1325/2646] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:49.134832 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fabc4-ad63-4d46-87dc-383b828c5a7b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:49.145968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fabc4-ad63-4d46-87dc-383b828c5a7b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:49.151441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:49.152039 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.152324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.152602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.153236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:49.155194 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:49.188174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1322/2647] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:49.193596 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:49.203782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794d2f-29f5-48d1-9276-d798f17bc230 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:49.279230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:49.279830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.280110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.280381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.281005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:49.283028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:49.306264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1326/2648] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:49 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:28:49.310060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:49.322321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36374d88-ff17-4d61-96e6-dd670e6c14b9 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:49.327187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:49.327797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.328074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.328341 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.328983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:49.330651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:49.341269 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1323/2649] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:49.346619 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:49.357368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559a27-8523-4a27-8658-590e7c7e5862 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:49.362761 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949abd75-268f-4c34-83bf-aad97869bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:49.363297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949abd75-268f-4c34-83bf-aad97869bbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.363571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949abd75-268f-4c34-83bf-aad97869bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.363833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949abd75-268f-4c34-83bf-aad97869bbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.364472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949abd75-268f-4c34-83bf-aad97869bbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:49.366062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949abd75-268f-4c34-83bf-aad97869bbc4 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:49.378896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1327/2650] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:49.383309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:49.393690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883722b-7ae9-44b8-807e-529c23cca82a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:49.398909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:49.399639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.399962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.400332 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] PATH_INFO: `/v3/projects/5a854c3d597f460db728f315d52cf913/users/2bf68e88f4cc4302af1162d1ac55c20f/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.415908 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a854c3d597f460db728f315d52cf913, user_id=2bf68e88f4cc4302af1162d1ac55c20f, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:49.418619 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:49.433753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1324/2651] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:49 2022] PUT /identity/v3/projects/5a854c3d597f460db728f315d52cf913/users/2bf68e88f4cc4302af1162d1ac55c20f/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:49.445760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c61b3-b598-40ca-84dd-6f2c5f7eebb9 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.446118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c61b3-b598-40ca-84dd-6f2c5f7eebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.446511 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c61b3-b598-40ca-84dd-6f2c5f7eebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.476773 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-045c61b3-b598-40ca-84dd-6f2c5f7eebb9 None None] MFA Rules not processed for user `2bf68e88f4cc4302af1162d1ac55c20f`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:49.478009 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-045c61b3-b598-40ca-84dd-6f2c5f7eebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:49.545211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1328/2652] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:49.557301 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:49.559081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:49.624981 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850210b-dc5e-4752-be52-374eff865a1d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:49.629259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253e7ee-84a1-48c0-a526-adfd4cd81d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:49.631012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253e7ee-84a1-48c0-a526-adfd4cd81d9d service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:49.631012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253e7ee-84a1-48c0-a526-adfd4cd81d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:49.631012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253e7ee-84a1-48c0-a526-adfd4cd81d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:49.639624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253e7ee-84a1-48c0-a526-adfd4cd81d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:49.641076 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253e7ee-84a1-48c0-a526-adfd4cd81d9d service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:49.653331 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1325/2653] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:52.812908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c61b3-b598-40ca-84dd-6f2c5f7eebb9 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:52.853510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:52.891251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c61b3-b598-40ca-84dd-6f2c5f7eebb9 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:52.897257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:52.897906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:52.898190 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:52.898495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] PATH_INFO: `/v3/users/2bf68e88f4cc4302af1162d1ac55c20f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:52.899650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bf68e88f4cc4302af1162d1ac55c20f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:52.901630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:52.992204 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bf68e88f4cc4302af1162d1ac55c20f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.019961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bf68e88f4cc4302af1162d1ac55c20f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.031437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bf68e88f4cc4302af1162d1ac55c20f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.032439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bf68e88f4cc4302af1162d1ac55c20f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.044608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bf68e88f4cc4302af1162d1ac55c20f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.060095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1329/2654] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:28:52 2022] DELETE /identity/v3/users/2bf68e88f4cc4302af1162d1ac55c20f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:53.062173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:53.062961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:53.062961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:53.090150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:53.091767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:53.166922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1326/2655] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:53.177881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:53.179542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:53.250508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b2ad9-6fbf-4468-a82e-3b81b6f44694 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:53.254809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ac11d-6dcb-42d3-84f3-1c2d38391370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:53.255419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ac11d-6dcb-42d3-84f3-1c2d38391370 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:53.255696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ac11d-6dcb-42d3-84f3-1c2d38391370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:53.255965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ac11d-6dcb-42d3-84f3-1c2d38391370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:53.265518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ac11d-6dcb-42d3-84f3-1c2d38391370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:53.267042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ac11d-6dcb-42d3-84f3-1c2d38391370 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:53.281642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1330/2656] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:53.579202 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:53.581270 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:53.606604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e76e4a-3acb-47ba-8e05-22ef7b7bd50a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:53.611446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:53.612188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:53.612477 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:53.612759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] PATH_INFO: `/v3/projects/5a854c3d597f460db728f315d52cf913` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:53.613950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a854c3d597f460db728f315d52cf913)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:53.615959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:53.628162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:53.677180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a854c3d597f460db728f315d52cf913', 'request_id': 'req-82c4af27-2432-4361-9848-04591d98b17c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.685835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a854c3d597f460db728f315d52cf913', 'request_id': 'req-82c4af27-2432-4361-9848-04591d98b17c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.694005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a854c3d597f460db728f315d52cf913', 'request_id': 'req-82c4af27-2432-4361-9848-04591d98b17c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.704246 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] The token cache is being invalidate because project 5a854c3d597f460db728f315d52cf913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:28:53.704575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.705228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-82c4af27-2432-4361-9848-04591d98b17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:28:53.706836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1327/2657] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:28:53 2022] DELETE /identity/v3/projects/5a854c3d597f460db728f315d52cf913 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:28:53.711823 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e1722-4f3a-4688-a1eb-ad28399dc0a4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:53.712108 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e1722-4f3a-4688-a1eb-ad28399dc0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:53.712384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e1722-4f3a-4688-a1eb-ad28399dc0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:53.732218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e78e1722-4f3a-4688-a1eb-ad28399dc0a4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:53.733456 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e78e1722-4f3a-4688-a1eb-ad28399dc0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:53.782728 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:53.796725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1331/2658] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:53.805193 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090296-9648-4bd6-95ed-4556a99eda2f None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:53.805485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090296-9648-4bd6-95ed-4556a99eda2f None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:53.805760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e090296-9648-4bd6-95ed-4556a99eda2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:53.826476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5e090296-9648-4bd6-95ed-4556a99eda2f None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:53.827688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5e090296-9648-4bd6-95ed-4556a99eda2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:53.836176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1328/2659] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:53.840343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e1722-4f3a-4688-a1eb-ad28399dc0a4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:53.853168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e1722-4f3a-4688-a1eb-ad28399dc0a4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:53.857991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:53.858637 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:53.858920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:53.859193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:53.859844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:28:53.860145 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:53.862765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:53.874726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1332/2660] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:28:53.879942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090296-9648-4bd6-95ed-4556a99eda2f None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:53.889167 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e090296-9648-4bd6-95ed-4556a99eda2f None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:53.894337 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:53.894931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:53.895206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:53.895474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:53.896107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:53.897993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:53.927485 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1329/2661] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:28:53 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:53.931885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:53.942816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625803a0-ed74-4590-b26d-6c7761a6a9fe admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.004244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.004734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.005013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.005290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.005942 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.007909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.039883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1333/2662] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:28:53 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:28:54.045343 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.065030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12627-a19b-452d-8abb-afac0921e6ad admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.073128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.074147 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.074791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.075296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.076500 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.080984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.104328 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1330/2663] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:54.105785 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.118451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d44c7-3926-4b61-a073-7a014880ad94 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.123673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d68c4-6006-498d-a572-e7f5bf911167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.124314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d68c4-6006-498d-a572-e7f5bf911167 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.124732 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d68c4-6006-498d-a572-e7f5bf911167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.125257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d68c4-6006-498d-a572-e7f5bf911167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.125692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d68c4-6006-498d-a572-e7f5bf911167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.127370 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d68c4-6006-498d-a572-e7f5bf911167 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.139424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1334/2664] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:28:54.143732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.164796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457114bd-2ad6-4745-be92-578b88eaafc8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.176764 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.177946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.178515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.179034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] PATH_INFO: `/v3/projects/d4b39154c71145fab74e8609b0c6bc11/users/fa1a7528481748199f4b610cac89a0bc/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.202048 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b39154c71145fab74e8609b0c6bc11, user_id=fa1a7528481748199f4b610cac89a0bc, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.205012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.225112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1331/2665] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:28:54 2022] PUT /identity/v3/projects/d4b39154c71145fab74e8609b0c6bc11/users/fa1a7528481748199f4b610cac89a0bc/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:28:54.233851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f88b1b-7232-4237-8c69-c76ea5955337 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.233851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f88b1b-7232-4237-8c69-c76ea5955337 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.233851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f88b1b-7232-4237-8c69-c76ea5955337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.265734 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c5f88b1b-7232-4237-8c69-c76ea5955337 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:54.267069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c5f88b1b-7232-4237-8c69-c76ea5955337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:54.338809 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1335/2666] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:54.351088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:54.353057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:54.425806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a882f-5236-43d4-8cd8-7754c9dc3e63 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:54.429583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:54.430203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:54.430516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:54.430795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:54.442103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:54.443594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:54.454622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1332/2667] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:55.218290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95000912-fc0a-4ddc-ba39-b30d86e9ad03 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:55.218828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95000912-fc0a-4ddc-ba39-b30d86e9ad03 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:55.218828 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95000912-fc0a-4ddc-ba39-b30d86e9ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:55.249881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-95000912-fc0a-4ddc-ba39-b30d86e9ad03 None None] MFA Rules not processed for user `fa1a7528481748199f4b610cac89a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:55.251175 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-95000912-fc0a-4ddc-ba39-b30d86e9ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:55.334442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:55.366766 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1336/2668] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:28:55.415944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:28:55.422322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:55.511515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:28:55.528941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673988b-784e-4d87-b33c-72a9e21637c2 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:28:55.533155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:28:55.533830 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:55.534112 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:55.534419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:55.543515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:28:55.545027 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:28:55.556267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1333/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:28:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:28:56.980332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8eb3d-59e6-44c7-b5b1-051f64fec6cc None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:28:56.980946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8eb3d-59e6-44c7-b5b1-051f64fec6cc None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:28:56.980946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8eb3d-59e6-44c7-b5b1-051f64fec6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:28:57.005349 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-dae8eb3d-59e6-44c7-b5b1-051f64fec6cc None None] MFA Rules not processed for user `fa1a7528481748199f4b610cac89a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:28:57.006630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dae8eb3d-59e6-44c7-b5b1-051f64fec6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:28:57.020081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1337/2670] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:28:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:05.551100 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=9 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:07.001354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=8 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:13.834765 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:13.836333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:13.850973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574c46-a4dc-4213-96ab-9d80196ff244 service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:13.855503 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:13.856124 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:13.856397 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:13.856665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] PATH_INFO: `/v3/users/7b9d1d5b4d4041b0b7b31a3462f97b73` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:13.857777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9d1d5b4d4041b0b7b31a3462f97b73)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:13.859718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:13.909986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9d1d5b4d4041b0b7b31a3462f97b73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:13.937797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9d1d5b4d4041b0b7b31a3462f97b73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:13.949353 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9d1d5b4d4041b0b7b31a3462f97b73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:13.962380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9d1d5b4d4041b0b7b31a3462f97b73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:13.963402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9d1d5b4d4041b0b7b31a3462f97b73'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:13.971126 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1334/2671] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:29:13 2022] DELETE /identity/v3/users/7b9d1d5b4d4041b0b7b31a3462f97b73 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:13.976638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:13.977199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:13.977199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:13.998089 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:13.999336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:14.070352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1338/2672] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:14.081697 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:14.083135 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:14.144928 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed9dde-0e39-4a1c-9ea8-7e1100866812 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:14.148678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af186aa5-08b9-45b4-b75f-4902d594bec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:14.149300 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186aa5-08b9-45b4-b75f-4902d594bec6 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.149582 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186aa5-08b9-45b4-b75f-4902d594bec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.149858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af186aa5-08b9-45b4-b75f-4902d594bec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.160563 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186aa5-08b9-45b4-b75f-4902d594bec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:14.162014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af186aa5-08b9-45b4-b75f-4902d594bec6 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:14.172091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1335/2673] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:14.598705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:14.598705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:14.611278 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cfa6e-74d1-4985-970d-6b7093d8d0cf None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:14.617534 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:14.618205 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.618520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.618791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] PATH_INFO: `/v3/projects/0841243863624c85ae9fc76f565df496` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.619991 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0841243863624c85ae9fc76f565df496)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:14.622020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:14.682640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0841243863624c85ae9fc76f565df496', 'request_id': 'req-14f705fa-3781-4126-b434-740191a1033a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.690835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0841243863624c85ae9fc76f565df496', 'request_id': 'req-14f705fa-3781-4126-b434-740191a1033a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.699010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0841243863624c85ae9fc76f565df496', 'request_id': 'req-14f705fa-3781-4126-b434-740191a1033a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.711542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] The token cache is being invalidate because project 0841243863624c85ae9fc76f565df496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:29:14.711882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.712843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-14f705fa-3781-4126-b434-740191a1033a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:29:14.714576 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1339/2674] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:29:14 2022] DELETE /identity/v3/projects/0841243863624c85ae9fc76f565df496 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:14.720380 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3584baf-aeb5-4637-ada9-f2a402820adf None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.720798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3584baf-aeb5-4637-ada9-f2a402820adf None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.721169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3584baf-aeb5-4637-ada9-f2a402820adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.741870 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b3584baf-aeb5-4637-ada9-f2a402820adf None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:14.743132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b3584baf-aeb5-4637-ada9-f2a402820adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:14.806855 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1336/2675] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:14.815124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b765a4-a71c-4587-9812-22befb9137cb None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.815406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b765a4-a71c-4587-9812-22befb9137cb None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.815685 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b765a4-a71c-4587-9812-22befb9137cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.837021 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-c8b765a4-a71c-4587-9812-22befb9137cb None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:14.838288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c8b765a4-a71c-4587-9812-22befb9137cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:14.847629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1340/2676] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:14.852696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3584baf-aeb5-4637-ada9-f2a402820adf None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:14.865529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3584baf-aeb5-4637-ada9-f2a402820adf None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:14.870835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:14.871457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.871762 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.872029 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.872755 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:29:14.873063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:14.874653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:14.888152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1337/2677] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:29:14.893354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b765a4-a71c-4587-9812-22befb9137cb None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:14.903311 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b765a4-a71c-4587-9812-22befb9137cb None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:14.909848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:14.910522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:14.910803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:14.911224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:14.911889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:14.913853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:14.946326 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1341/2678] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:14 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:29:14.950683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:14.956835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:14.967541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370032a6-9ae5-4b42-9ef1-6aecda44bc16 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.057034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.057658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.057946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.058423 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.059075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.061248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.086385 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1338/2679] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:14 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:15.090525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:15.102123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0faa-41ac-4eee-b4fb-ee0086c31b17 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.107407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.108019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.108295 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.108566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.109215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.111287 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.122876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1342/2680] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:15.127694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:15.138842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf9537-0161-4d32-a9bd-04793f0edbd7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.144893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7fc67-1423-40ad-b4dd-baf79135e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.145510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7fc67-1423-40ad-b4dd-baf79135e72b admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.145794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7fc67-1423-40ad-b4dd-baf79135e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.146065 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7fc67-1423-40ad-b4dd-baf79135e72b admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.146756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7fc67-1423-40ad-b4dd-baf79135e72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.148366 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7fc67-1423-40ad-b4dd-baf79135e72b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.161509 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1339/2681] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:15.166137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:15.183357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984db386-e273-4b9d-9352-694bbc444f52 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.190888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.191564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.191842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.192119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] PATH_INFO: `/v3/projects/10b54dc8317d4c1f8dab009567cc2193/users/0a67c37a2c4d4cd6bb343959d22abd84/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.209068 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b54dc8317d4c1f8dab009567cc2193, user_id=0a67c37a2c4d4cd6bb343959d22abd84, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.211853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.228813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1343/2682] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:15 2022] PUT /identity/v3/projects/10b54dc8317d4c1f8dab009567cc2193/users/0a67c37a2c4d4cd6bb343959d22abd84/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:29:15.234347 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396f83-7832-4d82-9195-6cad2a3ce2c6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.234633 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396f83-7832-4d82-9195-6cad2a3ce2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.234943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396f83-7832-4d82-9195-6cad2a3ce2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.257850 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f0396f83-7832-4d82-9195-6cad2a3ce2c6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:15.259122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f0396f83-7832-4d82-9195-6cad2a3ce2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:15.322702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1340/2683] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:15.336638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:15.338536 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:15.363122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:15.401663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5ad0e-ce7f-44d6-b52a-ef40c8cc0b1d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:15.405491 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:15.406138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:15.406479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:15.406755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:15.417627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:15.419118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:15.430690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1344/2684] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:20.226446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f89fe5-d3c7-4604-bba8-d135ee0e2193 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.228013 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f89fe5-d3c7-4604-bba8-d135ee0e2193 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.228515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f89fe5-d3c7-4604-bba8-d135ee0e2193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.271609 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-50f89fe5-d3c7-4604-bba8-d135ee0e2193 None None] MFA Rules not processed for user `0a67c37a2c4d4cd6bb343959d22abd84`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:20.273968 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-50f89fe5-d3c7-4604-bba8-d135ee0e2193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:20.386324 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1341/2685] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:29:20.391529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.402831 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e3165-55f7-4930-ab23-2d69a8813fd6 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.408243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.408998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.409384 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.409780 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.410678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.412747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.456627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1345/2686] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:29:20 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:20.459131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f89fe5-d3c7-4604-bba8-d135ee0e2193 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.474207 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f89fe5-d3c7-4604-bba8-d135ee0e2193 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.483468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:20.549885 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.550613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.550837 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.551114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.551767 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.553737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.588217 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1342/2687] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:29:20 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:29:20.589691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.617070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41087c4-da9e-4c35-a41e-2b56c248b448 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.625717 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.627944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.628586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.629168 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.630751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.634138 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.650053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1346/2688] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:29:20.655357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.670623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112969a-f90d-45dc-9417-18a25a7a6ee1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.676820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.677510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.677785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.678058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] PATH_INFO: `/v3/projects/a7fbd90791df497bbd3c7d2b625e0e2f/users/c21d6a7a622841459b582d4429376304/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.696184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fbd90791df497bbd3c7d2b625e0e2f, user_id=c21d6a7a622841459b582d4429376304, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.698965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.713395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1343/2689] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:20 2022] PUT /identity/v3/projects/a7fbd90791df497bbd3c7d2b625e0e2f/users/c21d6a7a622841459b582d4429376304/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:20.717964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.729268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031ed82-0cff-4786-9702-8b9cff06f824 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.824003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.824640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.824930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.825213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.825873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.827796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.848824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1347/2690] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:29:20.851187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:20.869213 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2f3db-b62c-4b20-a1db-a4ee350e0027 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:20.878900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8488c-cb64-4956-876b-d57f5c683193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:20.879893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8488c-cb64-4956-876b-d57f5c683193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:20.880445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8488c-cb64-4956-876b-d57f5c683193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:20.881115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8488c-cb64-4956-876b-d57f5c683193 admin admin] PATH_INFO: `/v3/projects/a7fbd90791df497bbd3c7d2b625e0e2f/users/c21d6a7a622841459b582d4429376304/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:20.883951 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8488c-cb64-4956-876b-d57f5c683193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fbd90791df497bbd3c7d2b625e0e2f, user_id=c21d6a7a622841459b582d4429376304, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:20.887317 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8488c-cb64-4956-876b-d57f5c683193 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:20.902909 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1344/2691] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:29:20 2022] PUT /identity/v3/projects/a7fbd90791df497bbd3c7d2b625e0e2f/users/c21d6a7a622841459b582d4429376304/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:29:24.617964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:24.619364 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:24.817507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5f5d7-4ae6-4d99-98ad-6883b0605480 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:24.933062 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:25.035859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:25.037203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:25.037772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:25.038473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:25.045788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:25.083483 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:25.092028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:25.128964 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1348/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:29:27.244711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ff9a-547c-4e79-af83-dfe844b8a3bb None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.245746 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ff9a-547c-4e79-af83-dfe844b8a3bb None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.246058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ff9a-547c-4e79-af83-dfe844b8a3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.292478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-0967ff9a-547c-4e79-af83-dfe844b8a3bb None None] MFA Rules not processed for user `c21d6a7a622841459b582d4429376304`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:27.293991 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0967ff9a-547c-4e79-af83-dfe844b8a3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:27.417653 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1345/2693] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:27.437148 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:27.438961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:27.567842 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd334bec-800f-4e0f-8435-942f094d4c3f service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:27.573154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '916a9bae3ca94918af4efdfcae19d928', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:27.574136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.574617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.575058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.672173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:27.676646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:27.686142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1349/2694] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:27.857326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e0bed-4603-4723-b8c1-9916a3452f4b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:27.857735 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e0bed-4603-4723-b8c1-9916a3452f4b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:27.858164 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e0bed-4603-4723-b8c1-9916a3452f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:27.926939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-092e0bed-4603-4723-b8c1-9916a3452f4b None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:27.928150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-092e0bed-4603-4723-b8c1-9916a3452f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:27.939929 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:28.021808 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1346/2695] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:29:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:28.069506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:28.070966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:28.138144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:28.179406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a862e7c-348d-4b59-bb42-28a3232a8e01 service glance] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:28.184982 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e50163-deda-49d0-9c5d-ad3e2f155892 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:28.185611 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50163-deda-49d0-9c5d-ad3e2f155892 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:28.185898 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50163-deda-49d0-9c5d-ad3e2f155892 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:28.186173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e50163-deda-49d0-9c5d-ad3e2f155892 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:28.195951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e50163-deda-49d0-9c5d-ad3e2f155892 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:28.197612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e50163-deda-49d0-9c5d-ad3e2f155892 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:28.206859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1350/2696] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:29:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 08:29:30.032683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6e68-abd0-4478-9a5c-605990454c7b None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:30.033961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6e68-abd0-4478-9a5c-605990454c7b None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:30.034481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6e68-abd0-4478-9a5c-605990454c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:30.055690 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f3ae6e68-abd0-4478-9a5c-605990454c7b None None] MFA Rules not processed for user `ba00229e9fd24a4e89c1aacdf47a1e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:30.057297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f3ae6e68-abd0-4478-9a5c-605990454c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:30.227446 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1347/2697] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:38.202891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=17 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:39.056826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:39.057127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:39.057375 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:39.078950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] MFA Rules not processed for user `0a67c37a2c4d4cd6bb343959d22abd84`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:29:39.080341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:39.087614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1351/2698] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:29:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:29:39.389221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae6e68-abd0-4478-9a5c-605990454c7b None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:39.469630 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae6e68-abd0-4478-9a5c-605990454c7b None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:39.474055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:39.475381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:39.475660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:39.475946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:39.477863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:39.489363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:39.490961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:39.502889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1348/2699] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:46.443379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:29:46.444908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:46.460490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67031-c718-4cf4-bf72-b8623e6675c0 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:29:46.465597 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:29:46.466220 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:29:46.466529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:29:46.466801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:29:46.468622 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:29:46.481292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:29:46.482943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:29:46.494975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1352/2700] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:29:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:29:49.496933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=73 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:29:56.490272 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=9 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:25.694087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:25.702835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe7ed-a9b7-4f94-b0e6-1439cefd4d17 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:25.706541 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:25.707130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:25.707408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:25.707680 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:25.709393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:25.782267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:25.783747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:25.801021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1349/2701] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:30:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:30:27.833843 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:30:27.843910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd1854-312d-49b4-b3a8-ec21815d7b58 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:30:27.849666 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:30:27.850288 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:30:27.850574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:30:27.850844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:30:27.852936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:30:27.868833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:30:27.870271 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:30:27.881656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1353/2702] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:30:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:30:35.790179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=34 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:30:37.876638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:31:52.418594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:31:52.419924 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:31:52.433949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874d8b6-aff0-4358-b61c-0cc43c24aa88 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:31:52.439428 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:31:52.440024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:31:52.440307 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:31:52.440586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:31:52.442823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:31:52.528742 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:31:52.530354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:31:52.540023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1350/2703] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:31:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:32:02.535455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=37 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:22.971136 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:33:22.972620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:33:22.986613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4dfe12-3e27-4091-942d-cf30fdf532c9 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:33:22.992111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:33:22.992699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:33:22.992978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:33:22.993259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:33:22.995018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:33:23.030462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:33:23.032055 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:33:23.051464 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1354/2704] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:33:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:33:33.048589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=19 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:33:55.894431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:33:55.906739 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e4996-fdb0-4c70-86da-946ab41c3fd6 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:33:55.912280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e676a76-37ed-4cf0-a625-6c413536c347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:33:55.912882 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e676a76-37ed-4cf0-a625-6c413536c347 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:33:55.913163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e676a76-37ed-4cf0-a625-6c413536c347 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:33:55.913438 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e676a76-37ed-4cf0-a625-6c413536c347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:33:55.915199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2e676a76-37ed-4cf0-a625-6c413536c347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:33:55.977150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e676a76-37ed-4cf0-a625-6c413536c347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:33:55.978774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e676a76-37ed-4cf0-a625-6c413536c347 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:33:55.988412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1351/2705] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:33:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:02.899293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:02.911079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c997ff3-d78f-45b3-b2f7-d67d95959d9d service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:02.916659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:02.917265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:02.917542 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:02.917799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:02.919572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:02.931230 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:02.932801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:02.943862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1355/2706] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:05.047034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e9f8-6c44-4c29-87b1-8958dab2bbdc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:05.047606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e9f8-6c44-4c29-87b1-8958dab2bbdc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:05.047606 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972e9f8-6c44-4c29-87b1-8958dab2bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:05.079046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-b972e9f8-6c44-4c29-87b1-8958dab2bbdc None None] MFA Rules not processed for user `b637e39164d5418f88eb442894c2ad46`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:34:05.080264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b972e9f8-6c44-4c29-87b1-8958dab2bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:05.098441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1352/2707] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:34:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:34:05.437612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:05.447218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf6285-b346-4dc4-bc8d-41228bc2564d service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:05.451335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:05.451943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:05.452251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:05.452529 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:05.454348 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:05.466539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:05.467986 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:05.476613 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1356/2708] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:05.800026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e9f8-6c44-4c29-87b1-8958dab2bbdc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:05.812936 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972e9f8-6c44-4c29-87b1-8958dab2bbdc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:05.818002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:05.818661 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:05.818946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:05.819223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:05.821008 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:05.834026 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:05.835655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:05.846727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1353/2709] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:15.472712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=12 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:15.841790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=44 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:28.457018 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:28.470790 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77744487-e09b-4916-85ed-25ff637847d3 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:28.476816 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecbfc2-7b9b-442e-bfcf-55b86b24b564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:28.477424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecbfc2-7b9b-442e-bfcf-55b86b24b564 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:28.477708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecbfc2-7b9b-442e-bfcf-55b86b24b564 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:28.478007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecbfc2-7b9b-442e-bfcf-55b86b24b564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:28.487194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecbfc2-7b9b-442e-bfcf-55b86b24b564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:28.488802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecbfc2-7b9b-442e-bfcf-55b86b24b564 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:28.499412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1357/2710] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:38.494663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:34:50.402143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:50.457919 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494976d-0375-4a2e-9d59-d6671f21c7a2 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:50.462804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:50.463409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:50.463686 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:50.463957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:50.472955 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:50.474548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:50.484873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1354/2711] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:34:58.106225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248722e1-909e-4609-8767-441bea397922 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:58.106826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248722e1-909e-4609-8767-441bea397922 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:58.106826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248722e1-909e-4609-8767-441bea397922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:58.135943 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-248722e1-909e-4609-8767-441bea397922 None None] MFA Rules not processed for user `fa1a7528481748199f4b610cac89a0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:34:58.137153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-248722e1-909e-4609-8767-441bea397922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:34:58.144146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1358/2712] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:34:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:34:58.380327 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:34:58.389984 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5725aca-5482-46e4-a45e-1606229e6b6f service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:34:58.393753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:34:58.394478 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:34:58.394819 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:34:58.395155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:34:58.402883 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:34:58.404376 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:34:58.413950 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1355/2713] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:34:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:08.131091 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:08.410876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=31 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:26.107480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248722e1-909e-4609-8767-441bea397922 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:26.118016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248722e1-909e-4609-8767-441bea397922 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:26.121620 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:26.122219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:26.122525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:26.122837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:26.134105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:26.135564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:26.146659 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1359/2714] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:28.520506 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:28.545139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef5ce4-85fe-4894-b5fa-4bd138764e0a service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:28.549671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4f9b52-4f4a-4461-a7a7-eb969774b700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:28.550309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f9b52-4f4a-4461-a7a7-eb969774b700 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:28.550594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f9b52-4f4a-4461-a7a7-eb969774b700 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:28.550874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f9b52-4f4a-4461-a7a7-eb969774b700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:28.569539 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f9b52-4f4a-4461-a7a7-eb969774b700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:28.570944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4f9b52-4f4a-4461-a7a7-eb969774b700 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:28.594396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1356/2715] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:32.282457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:32.297699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceacb4-acfa-4ed7-bc3b-c00685704bec service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:32.302829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:32.303415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:32.303693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:32.303962 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:32.312465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:32.314601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:32.324322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1360/2716] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:38.590778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=19 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:40.933433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:40.934281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:40.934281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:40.958316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:35:40.959559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:40.966863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1357/2717] 10.222.0.36 () {58 vars in 967 bytes} [Thu Sep 1 08:35:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:35:41.020607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:41.032046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269725-fdbe-42bb-bb2a-ddd2d8dcb014 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:41.038178 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:41.038852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:41.039128 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:41.039397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:41.048174 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:41.049746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:41.057960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1361/2718] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:35:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:35:41.371075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:41.372655 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:41.397938 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2086c2f-8704-47e9-81bd-85430d76d349 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:41.401534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:41.402134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:41.402514 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:41.402794 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:41.463933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:41.465388 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:41.475849 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1358/2719] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:44.846861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:44.859498 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fccdf2-5233-4d73-b0cb-5b64a3242d2f service swift] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:44.879396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:44.880587 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:44.880873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:44.881153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:44.883004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:44.924308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:44.926095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:44.937836 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1362/2720] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:48.327592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:48.339216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6b7c3-ec29-427d-97f4-2c8999ea2f59 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:48.344652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:48.345278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:48.345533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:48.345807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:48.348490 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:48.360688 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:48.362362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:48.374790 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1359/2721] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:48.403117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:48.408459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=32 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:48.416952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc1e9-0460-47bd-bf02-9c235bd1b185 service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:48.426131 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:48.426612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:48.426920 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:48.427203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] PATH_INFO: `/v3/users/0a67c37a2c4d4cd6bb343959d22abd84` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:48.428643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a67c37a2c4d4cd6bb343959d22abd84)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:48.431368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:48.500747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a67c37a2c4d4cd6bb343959d22abd84'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.521515 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a67c37a2c4d4cd6bb343959d22abd84'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.535703 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a67c37a2c4d4cd6bb343959d22abd84'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.536493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a67c37a2c4d4cd6bb343959d22abd84'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.546022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a67c37a2c4d4cd6bb343959d22abd84'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.556284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1363/2722] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:35:48 2022] DELETE /identity/v3/users/0a67c37a2c4d4cd6bb343959d22abd84 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:48.778362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:48.792267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00796a15-2487-4d87-baff-9fbaff735ec5 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:48.881510 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:48.882186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:48.882515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:48.882793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] PATH_INFO: `/v3/projects/10b54dc8317d4c1f8dab009567cc2193` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:48.883973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b54dc8317d4c1f8dab009567cc2193)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:48.888185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:48.953429 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b54dc8317d4c1f8dab009567cc2193', 'request_id': 'req-d888a313-4a92-4590-b8f5-d137bac440d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.962513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b54dc8317d4c1f8dab009567cc2193', 'request_id': 'req-d888a313-4a92-4590-b8f5-d137bac440d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.969645 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b54dc8317d4c1f8dab009567cc2193', 'request_id': 'req-d888a313-4a92-4590-b8f5-d137bac440d6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.974571 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:48.984674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] The token cache is being invalidate because project 10b54dc8317d4c1f8dab009567cc2193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:35:48.985491 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.987197 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:48.988974 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1360/2723] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:35:48 2022] DELETE /identity/v3/projects/10b54dc8317d4c1f8dab009567cc2193 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:35:48.993102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:48.994570 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:49.009766 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299919-0273-4f9f-b576-53e7e60d3cdb admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:49.072854 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:49.073400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:49.073675 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:49.073947 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] PATH_INFO: `/v3/users/c21d6a7a622841459b582d4429376304` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:49.075216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21d6a7a622841459b582d4429376304)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:49.077153 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:49.129566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21d6a7a622841459b582d4429376304'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.143608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21d6a7a622841459b582d4429376304'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.151516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21d6a7a622841459b582d4429376304'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.152301 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21d6a7a622841459b582d4429376304'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.155053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:49.161905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21d6a7a622841459b582d4429376304'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.169492 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1364/2724] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:35:48 2022] DELETE /identity/v3/users/c21d6a7a622841459b582d4429376304 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:49.353271 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:49.354800 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:49.372236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888a313-4a92-4590-b8f5-d137bac440d6 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:49.441863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:49.442535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:49.442843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:49.444760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] PATH_INFO: `/v3/projects/a7fbd90791df497bbd3c7d2b625e0e2f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:49.444760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fbd90791df497bbd3c7d2b625e0e2f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:49.446579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:49.503775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fbd90791df497bbd3c7d2b625e0e2f', 'request_id': 'req-0277a695-9cf6-4e57-a103-b048893d5fc7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.511844 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fbd90791df497bbd3c7d2b625e0e2f', 'request_id': 'req-0277a695-9cf6-4e57-a103-b048893d5fc7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.519002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fbd90791df497bbd3c7d2b625e0e2f', 'request_id': 'req-0277a695-9cf6-4e57-a103-b048893d5fc7'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.529681 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] The token cache is being invalidate because project a7fbd90791df497bbd3c7d2b625e0e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:35:49.529966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.530660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:49.532179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1361/2725] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:35:49 2022] DELETE /identity/v3/projects/a7fbd90791df497bbd3c7d2b625e0e2f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:49.661661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:49.663658 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:49.734368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe7b2b-8e7f-493b-a168-f2fe454c1cff admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:49.795408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:49.796042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:49.796318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:49.796586 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:49.798621 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:49.874176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:49.875663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:49.886721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1365/2726] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:35:50.482863 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:50.485940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:50.512195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277a695-9cf6-4e57-a103-b048893d5fc7 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:50.520447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:50.521357 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:50.521779 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:50.522154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] PATH_INFO: `/v3/users/ba00229e9fd24a4e89c1aacdf47a1e2f` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:50.523482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba00229e9fd24a4e89c1aacdf47a1e2f)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:50.525555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:50.606005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba00229e9fd24a4e89c1aacdf47a1e2f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:50.624528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba00229e9fd24a4e89c1aacdf47a1e2f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:50.635583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba00229e9fd24a4e89c1aacdf47a1e2f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:50.643304 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:50.646519 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba00229e9fd24a4e89c1aacdf47a1e2f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:50.647416 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-3214f0e8-24e8-4292-9921-11f0eb8e1ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba00229e9fd24a4e89c1aacdf47a1e2f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:50.658945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1362/2727] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:35:50 2022] DELETE /identity/v3/users/ba00229e9fd24a4e89c1aacdf47a1e2f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:35:50.874848 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:50.887378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d894d-2cd2-4e46-8ee2-d1e3680bb386 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:50.980465 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:50.981113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:50.981397 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:50.981676 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] PATH_INFO: `/v3/projects/da9b0c43d715429c963f0372d2ad9fdf` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:50.982858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9b0c43d715429c963f0372d2ad9fdf)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:50.984975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:50.987562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:51.045170 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9b0c43d715429c963f0372d2ad9fdf', 'request_id': 'req-1cde5067-d025-4bf1-a954-74c7ec45b1e5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:51.054264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9b0c43d715429c963f0372d2ad9fdf', 'request_id': 'req-1cde5067-d025-4bf1-a954-74c7ec45b1e5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:51.066824 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9b0c43d715429c963f0372d2ad9fdf', 'request_id': 'req-1cde5067-d025-4bf1-a954-74c7ec45b1e5'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:51.079906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] The token cache is being invalidate because project da9b0c43d715429c963f0372d2ad9fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:35:51.080196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:51.080914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1cde5067-d025-4bf1-a954-74c7ec45b1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:35:51.086302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1366/2728] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:35:50 2022] DELETE /identity/v3/projects/da9b0c43d715429c963f0372d2ad9fdf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:51.087784 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516d48-ff9c-4412-b19e-00021154f51c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.088073 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516d48-ff9c-4412-b19e-00021154f51c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.088360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73516d48-ff9c-4412-b19e-00021154f51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.110723 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-73516d48-ff9c-4412-b19e-00021154f51c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:35:51.112946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-73516d48-ff9c-4412-b19e-00021154f51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:51.177265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1363/2729] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:35:51.186259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f0171-c417-4302-9ab5-a9451ff56aae None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.186554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f0171-c417-4302-9ab5-a9451ff56aae None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.186841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f0171-c417-4302-9ab5-a9451ff56aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.208636 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-272f0171-c417-4302-9ab5-a9451ff56aae None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:35:51.209803 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-272f0171-c417-4302-9ab5-a9451ff56aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:51.218551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1367/2730] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:35:51.223507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73516d48-ff9c-4412-b19e-00021154f51c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:51.233493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73516d48-ff9c-4412-b19e-00021154f51c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:51.239020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:51.239634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.239913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.240187 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.240842 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:35:51.242966 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:51.244604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:51.259660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1364/2731] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:35:51.264217 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f0171-c417-4302-9ab5-a9451ff56aae None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:51.275698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f0171-c417-4302-9ab5-a9451ff56aae None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:51.281213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:51.281965 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.282289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.283015 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.285654 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:51.287909 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:51.318745 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1368/2732] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:35:51 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:35:51.320309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:51.331154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1853c-d999-481f-9729-371095a309be admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:51.388431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:51.389035 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.389312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.389579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.390211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:51.392141 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:51.414752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1365/2733] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:35:51 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:35:51.419115 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:51.430339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efeaaf0-a9e3-4c24-931f-574c7931422b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:51.435008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:51.435693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.435968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.436236 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.436876 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:51.438494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:51.449627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1369/2734] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:35:51.453827 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:51.464720 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6ff24-c95c-47e6-ac61-022fc0d48995 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:51.469774 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b329179-3f7a-4485-a9da-b2944478afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:51.470431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b329179-3f7a-4485-a9da-b2944478afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.470717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b329179-3f7a-4485-a9da-b2944478afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.471134 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b329179-3f7a-4485-a9da-b2944478afb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.471892 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b329179-3f7a-4485-a9da-b2944478afb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:51.473508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b329179-3f7a-4485-a9da-b2944478afb1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:51.484835 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1366/2735] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:35:51.490185 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:51.501058 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163bb5-4e36-4ce6-ad38-a58a7878e259 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:51.507525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:51.508193 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.508477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.508753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] PATH_INFO: `/v3/projects/39afc2ba4f5b483f916fd0d229b76818/users/65d25899f57a40a19ebbceea38aa396b/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.525473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39afc2ba4f5b483f916fd0d229b76818, user_id=65d25899f57a40a19ebbceea38aa396b, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:51.528160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:51.542486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1370/2736] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:35:51 2022] PUT /identity/v3/projects/39afc2ba4f5b483f916fd0d229b76818/users/65d25899f57a40a19ebbceea38aa396b/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:51.548002 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181301d-3b87-4f06-be74-5dad8cf8b40d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.548815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181301d-3b87-4f06-be74-5dad8cf8b40d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.548815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181301d-3b87-4f06-be74-5dad8cf8b40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.570737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-d181301d-3b87-4f06-be74-5dad8cf8b40d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:35:51.571970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-d181301d-3b87-4f06-be74-5dad8cf8b40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:51.634513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1367/2737] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:35:51.644680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:51.646442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:51.704463 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c2215-6a30-4c02-9b05-b31045ff2a4a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:51.708444 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:51.709047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:51.709323 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:51.709594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:51.719332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:51.720688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:51.731014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1371/2738] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:35:56.520667 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2cab3-c975-48ae-b1c3-e66ca42a3bf5 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:56.521281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2cab3-c975-48ae-b1c3-e66ca42a3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:56.525970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2cab3-c975-48ae-b1c3-e66ca42a3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:56.534275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:56.563896 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-22c2cab3-c975-48ae-b1c3-e66ca42a3bf5 None None] MFA Rules not processed for user `65d25899f57a40a19ebbceea38aa396b`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:35:56.565359 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-22c2cab3-c975-48ae-b1c3-e66ca42a3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:35:56.640554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1368/2739] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:35:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:35:56.645421 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:56.660478 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cc76-fce5-496f-9bba-19317f2da430 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:56.665756 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:56.666518 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:56.666889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:56.667261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:56.667985 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:56.669979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:56.697453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1372/2740] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:35:56 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:35:56.701836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2cab3-c975-48ae-b1c3-e66ca42a3bf5 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:56.712875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2cab3-c975-48ae-b1c3-e66ca42a3bf5 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:56.898261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:56.898889 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:56.899162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:56.899431 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:56.900069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:56.902001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:56.927996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1369/2741] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:35:56 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:35:56.932861 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:56.945123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97d8e8-80bf-409a-b138-d6ff528a1917 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:56.950624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:56.951544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:56.951910 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:56.952276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:56.953199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:56.955019 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:56.957748 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:35:56.972341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1373/2742] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:35:56.976249 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:56.990195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970aa4f4-646d-48c1-8fd9-d11c51b3e8df admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:56.995473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:56.996123 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:56.996395 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:56.996676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] PATH_INFO: `/v3/projects/c651c3be4a6e4966aeb726f2538c630b/users/cc62dec9fae04e539001eff0812441f8/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:57.024769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c651c3be4a6e4966aeb726f2538c630b, user_id=cc62dec9fae04e539001eff0812441f8, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:57.028273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:57.044528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1370/2743] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:35:56 2022] PUT /identity/v3/projects/c651c3be4a6e4966aeb726f2538c630b/users/cc62dec9fae04e539001eff0812441f8/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:35:57.048477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:57.063735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0c329-09b2-4b64-901f-295ad8f11b65 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:57.137318 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a444b6-378d-499e-bdd1-6d5dd47de8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:57.137978 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a444b6-378d-499e-bdd1-6d5dd47de8ca admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:57.138367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a444b6-378d-499e-bdd1-6d5dd47de8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:57.138643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a444b6-378d-499e-bdd1-6d5dd47de8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:57.139285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a444b6-378d-499e-bdd1-6d5dd47de8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:57.140871 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a444b6-378d-499e-bdd1-6d5dd47de8ca admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:57.151107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1374/2744] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:35:57.155320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:35:57.166587 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fa13b-9d3a-4dca-a541-5647672a1b57 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:35:57.171374 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:35:57.172036 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:35:57.172336 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:35:57.172592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] PATH_INFO: `/v3/projects/c651c3be4a6e4966aeb726f2538c630b/users/cc62dec9fae04e539001eff0812441f8/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:35:57.175311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c651c3be4a6e4966aeb726f2538c630b, user_id=cc62dec9fae04e539001eff0812441f8, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:35:57.179752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:35:57.190427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1371/2745] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:35:57 2022] PUT /identity/v3/projects/c651c3be4a6e4966aeb726f2538c630b/users/cc62dec9fae04e539001eff0812441f8/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:36:01.870459 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce688c8-3b98-4450-bd89-143962e5010c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:36:01.871006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce688c8-3b98-4450-bd89-143962e5010c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:36:01.871006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce688c8-3b98-4450-bd89-143962e5010c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:36:01.908868 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7ce688c8-3b98-4450-bd89-143962e5010c None None] MFA Rules not processed for user `cc62dec9fae04e539001eff0812441f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:36:01.910308 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7ce688c8-3b98-4450-bd89-143962e5010c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:36:01.986746 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1375/2746] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:36:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:36:02.000838 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:36:02.002946 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:36:02.065175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:02.108636 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3d3df-c615-4095-86b4-d11335c8b062 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:36:02.114895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:36:02.115528 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:36:02.115812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:36:02.116088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:36:02.178086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:36:02.179745 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:36:02.189186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1372/2747] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:36:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:36:03.224494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680022e-82bc-44e8-a831-c2bc6783f920 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:36:03.224996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680022e-82bc-44e8-a831-c2bc6783f920 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:36:03.225122 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680022e-82bc-44e8-a831-c2bc6783f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:36:03.245052 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-7680022e-82bc-44e8-a831-c2bc6783f920 None None] MFA Rules not processed for user `65d25899f57a40a19ebbceea38aa396b`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:36:03.246307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7680022e-82bc-44e8-a831-c2bc6783f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:36:03.253372 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1376/2748] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:36:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:36:12.184875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=41 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:13.239215 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=68 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:36:52.513362 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:36:52.514918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:36:52.529547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2922899-a077-4371-90ce-267f7c4e169a service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:36:52.535922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:36:52.536527 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:36:52.536806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:36:52.537078 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:36:52.538874 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:36:52.598218 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:36:52.599860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:36:52.608992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1373/2749] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:36:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:37:02.604926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=28 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:38:55.725827 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680022e-82bc-44e8-a831-c2bc6783f920 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:38:55.741544 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680022e-82bc-44e8-a831-c2bc6783f920 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:38:55.747608 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:38:55.748212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:38:55.748490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:38:55.748763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:38:55.750522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:38:55.830140 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:38:55.831772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:38:55.851010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1377/2750] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:38:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:39:05.848139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=41 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:39:54.422775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:39:54.424210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:39:54.496773 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ed23a-0ca7-4e99-9bbc-9eac8a1fae07 service nova] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:39:54.501797 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:39:54.502468 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:39:54.502754 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:39:54.503031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:39:54.504787 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:39:54.516432 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:39:54.517989 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:39:54.527814 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1374/2751] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:39:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:04.523689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=32 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:06.185200 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:06.186678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:06.201859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ebf95-ff71-4971-aba7-8f521e43d82d service nova] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:06.207008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:06.207607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:06.207887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:06.208161 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:06.209875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:06.221735 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:06.223359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:06.233165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1378/2752] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:07.048689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:07.050208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:07.107482 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecfb82-e316-43f2-85f4-33a621109eb0 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:07.111262 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:07.111886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:07.112176 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:07.112456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:07.114252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:07.204811 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:07.206208 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:07.226900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1375/2753] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:10.601213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:10.603005 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:10.627993 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab60c6-cab2-4e64-b183-64dc2a0a274a service placement] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:10.636362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:10.637439 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:10.637952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:10.638517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] PATH_INFO: `/v3/users/b637e39164d5418f88eb442894c2ad46` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:10.640517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b637e39164d5418f88eb442894c2ad46)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:10.644474 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:10.694960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b637e39164d5418f88eb442894c2ad46'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:10.707956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b637e39164d5418f88eb442894c2ad46'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:10.715490 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b637e39164d5418f88eb442894c2ad46'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:10.716123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b637e39164d5418f88eb442894c2ad46'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:10.723810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-24f5d0c6-48d5-435b-a13f-33c9d4576eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b637e39164d5418f88eb442894c2ad46'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:10.730409 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1379/2754] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:10 2022] DELETE /identity/v3/users/b637e39164d5418f88eb442894c2ad46 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:10.929433 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:10.946471 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fdd5c-34b9-4ece-af7b-2ca56a44d457 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.006574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.007200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.007474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.007744 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] PATH_INFO: `/v3/projects/9ed1bc7f289940728f3f80d2d79588a3` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.008875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed1bc7f289940728f3f80d2d79588a3)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.010997 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.036674 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:11.064232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed1bc7f289940728f3f80d2d79588a3', 'request_id': 'req-f89b748e-3580-475c-b9e7-73763d635673'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:11.073917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed1bc7f289940728f3f80d2d79588a3', 'request_id': 'req-f89b748e-3580-475c-b9e7-73763d635673'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:11.080494 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed1bc7f289940728f3f80d2d79588a3', 'request_id': 'req-f89b748e-3580-475c-b9e7-73763d635673'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:11.092429 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] The token cache is being invalidate because project 9ed1bc7f289940728f3f80d2d79588a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:11.092725 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:11.093398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-f89b748e-3580-475c-b9e7-73763d635673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:11.094925 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1376/2755] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:10 2022] DELETE /identity/v3/projects/9ed1bc7f289940728f3f80d2d79588a3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:11.100129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1a23a-076e-4657-958b-a53ff2e00617 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.100449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1a23a-076e-4657-958b-a53ff2e00617 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.100724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1a23a-076e-4657-958b-a53ff2e00617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.162390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-76a1a23a-076e-4657-958b-a53ff2e00617 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:11.163626 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-76a1a23a-076e-4657-958b-a53ff2e00617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:11.223307 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1380/2756] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:11.231454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1091-d081-4839-93d1-e6fdadb8b8dc None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.231729 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1091-d081-4839-93d1-e6fdadb8b8dc None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.231994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef1091-d081-4839-93d1-e6fdadb8b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.251770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-86ef1091-d081-4839-93d1-e6fdadb8b8dc None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:11.252965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-86ef1091-d081-4839-93d1-e6fdadb8b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:11.261283 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1377/2757] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:11.265574 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1a23a-076e-4657-958b-a53ff2e00617 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.275468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1a23a-076e-4657-958b-a53ff2e00617 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.280207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.280808 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.281090 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.281361 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.282004 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:40:11.282330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.283934 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.295445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1381/2758] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:40:11.299839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef1091-d081-4839-93d1-e6fdadb8b8dc None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.309758 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef1091-d081-4839-93d1-e6fdadb8b8dc None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.314473 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.315090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.315340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.315611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.316236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.318125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.355589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1378/2759] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:11 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:11.359634 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.370928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03211bb-f275-470c-b4dd-546d9d48cfbd admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.382979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:11.429913 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.430553 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.430829 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.431097 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.432552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.434566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.456507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1382/2760] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:11 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:11.460425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.471120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef2087-eef1-4106-873d-7974c1df2ed3 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.476030 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.476624 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.476899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.477175 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.477809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.479511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.489598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1379/2761] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:11.493615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.504207 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006fb55-a821-410c-94a2-b7fd6c136b3d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.508817 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e54eaa-36be-4aaa-8d3b-b7abd8a0bd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.509413 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e54eaa-36be-4aaa-8d3b-b7abd8a0bd35 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.509721 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e54eaa-36be-4aaa-8d3b-b7abd8a0bd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.509996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e54eaa-36be-4aaa-8d3b-b7abd8a0bd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.511274 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e54eaa-36be-4aaa-8d3b-b7abd8a0bd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.512859 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e54eaa-36be-4aaa-8d3b-b7abd8a0bd35 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.523381 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1383/2762] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:11.527531 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.537523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28072e6e-3feb-4b15-a94a-7e6492cd8628 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.545273 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.545939 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.546221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.546538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] PATH_INFO: `/v3/projects/9a20d0f8f4004342b448ce4e91cd1e28/users/1ac0d440f1714d8dba4204bd8f14ca5f/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.565184 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a20d0f8f4004342b448ce4e91cd1e28, user_id=1ac0d440f1714d8dba4204bd8f14ca5f, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.568321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.583550 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1380/2763] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:11 2022] PUT /identity/v3/projects/9a20d0f8f4004342b448ce4e91cd1e28/users/1ac0d440f1714d8dba4204bd8f14ca5f/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:11.593166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4356-6a21-4f4c-a3ad-4bdef0f5c1f4 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.594077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4356-6a21-4f4c-a3ad-4bdef0f5c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.594469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf4356-6a21-4f4c-a3ad-4bdef0f5c1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.626210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-73cf4356-6a21-4f4c-a3ad-4bdef0f5c1f4 None None] MFA Rules not processed for user `1ac0d440f1714d8dba4204bd8f14ca5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:11.627486 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-73cf4356-6a21-4f4c-a3ad-4bdef0f5c1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:11.699805 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1384/2764] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:11.704339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.771803 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f4293-e59c-4515-b287-e67c9a8ba728 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.777886 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.778559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.778841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.779133 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.779750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.781649 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.809154 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1381/2765] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:11 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:11.813455 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4356-6a21-4f4c-a3ad-4bdef0f5c1f4 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.824617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf4356-6a21-4f4c-a3ad-4bdef0f5c1f4 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.880255 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.880781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.881060 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.881335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.881959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.883916 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.905075 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1385/2766] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:11 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:11.909066 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.921701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f4cce-d21b-4ec7-945a-eb1017a62e9a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.927056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.927671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.927944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.928211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.928858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.930505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:11.941987 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1382/2767] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:11.946264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:11.957184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c3c2-7dfe-4900-a00f-a500705a2c61 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:11.962188 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:11.963432 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:11.964262 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:11.964669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] PATH_INFO: `/v3/projects/ff8af73c693a4ad2b6558f23bddf1047/users/465e14b970ca49dcb2babc256a2a7496/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:11.976528 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:11.981335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8af73c693a4ad2b6558f23bddf1047, user_id=465e14b970ca49dcb2babc256a2a7496, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:11.984727 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:12.000154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1386/2768] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:11 2022] PUT /identity/v3/projects/ff8af73c693a4ad2b6558f23bddf1047/users/465e14b970ca49dcb2babc256a2a7496/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:12.004177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:12.014206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd51706-c0d7-4e2a-807b-c98665324e77 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:12.024467 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:12.082553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b2807-18fe-4569-bb48-3f4487543991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:12.083161 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b2807-18fe-4569-bb48-3f4487543991 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:12.084199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b2807-18fe-4569-bb48-3f4487543991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:12.084516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b2807-18fe-4569-bb48-3f4487543991 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:12.085151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b2807-18fe-4569-bb48-3f4487543991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:12.087155 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b2807-18fe-4569-bb48-3f4487543991 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:12.098523 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1383/2769] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:12.102583 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:12.113791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9724b6b-3c04-4e05-83db-4c78db0fe1dc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:12.118419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:12.119070 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:12.119351 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:12.119700 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] PATH_INFO: `/v3/projects/ff8af73c693a4ad2b6558f23bddf1047/users/465e14b970ca49dcb2babc256a2a7496/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:12.121905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8af73c693a4ad2b6558f23bddf1047, user_id=465e14b970ca49dcb2babc256a2a7496, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:12.124588 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:12.135335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1387/2770] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:12 2022] PUT /identity/v3/projects/ff8af73c693a4ad2b6558f23bddf1047/users/465e14b970ca49dcb2babc256a2a7496/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:12.146110 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95033ef-9cd4-4064-a945-ff4638830f64 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:12.146452 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95033ef-9cd4-4064-a945-ff4638830f64 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:12.146731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95033ef-9cd4-4064-a945-ff4638830f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:12.178584 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a95033ef-9cd4-4064-a945-ff4638830f64 None None] MFA Rules not processed for user `465e14b970ca49dcb2babc256a2a7496`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:12.179841 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a95033ef-9cd4-4064-a945-ff4638830f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:12.249012 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1384/2771] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:12.261117 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:12.262882 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:12.344569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4dbf0a-652c-4665-a773-f2d9162477f6 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:12.348625 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:12.349225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:12.349506 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:12.349782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:12.359273 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:12.360714 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:12.370599 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1388/2772] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:12.448499 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95033ef-9cd4-4064-a945-ff4638830f64 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:12.459022 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95033ef-9cd4-4064-a945-ff4638830f64 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:12.462714 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:12.463888 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:12.464320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:12.464602 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:12.526826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:12.528265 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:12.537525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1385/2773] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:22.365951 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:22.533340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:27.198012 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:27.199781 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:27.258531 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4176be0-50b5-419f-a051-17a0a4090e0f service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:27.262521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:27.263139 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:27.263417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:27.263686 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:27.265437 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:27.342342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:27.343796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:27.355415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1389/2774] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:28.579599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:28.590534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc1958-7db7-4e7e-91af-bc09235e208c service cinder] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:28.595891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d382-c38d-4075-92b9-dc776b0b1c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:28.596538 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d382-c38d-4075-92b9-dc776b0b1c39 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:28.596826 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d382-c38d-4075-92b9-dc776b0b1c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:28.597098 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d382-c38d-4075-92b9-dc776b0b1c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:28.599057 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5435d382-c38d-4075-92b9-dc776b0b1c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:28.613483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d382-c38d-4075-92b9-dc776b0b1c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:28.614969 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d382-c38d-4075-92b9-dc776b0b1c39 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:28.626592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1386/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:37.350077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=54 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:38.621604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=6 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:41.957737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:42.019203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f463c-0cac-4bd8-b264-eeea6fdffdd3 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:42.023677 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:42.024289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:42.024566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:42.024838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] PATH_INFO: `/v3/users/1ac0d440f1714d8dba4204bd8f14ca5f` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:42.025956 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac0d440f1714d8dba4204bd8f14ca5f)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:42.028605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:42.073855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac0d440f1714d8dba4204bd8f14ca5f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.085602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac0d440f1714d8dba4204bd8f14ca5f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.093212 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac0d440f1714d8dba4204bd8f14ca5f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.093881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac0d440f1714d8dba4204bd8f14ca5f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.101692 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac0d440f1714d8dba4204bd8f14ca5f'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.108210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1390/2776] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:41 2022] DELETE /identity/v3/users/1ac0d440f1714d8dba4204bd8f14ca5f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:42.112731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:42.113179 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:42.113296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:42.132931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:42.134129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:42.196543 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1387/2777] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:40:42.206480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:42.207887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:42.266638 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c2485-04aa-4005-8734-5e566b5d20fc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:42.270468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:42.271076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:42.271354 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:42.271624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:42.281457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:42.282973 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:42.293050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1391/2778] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:42.564403 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:42.565941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:42.586741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88274f43-3fc3-4010-95fd-a183c0631918 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:42.595930 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:42.596574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:42.596859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:42.597183 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] PATH_INFO: `/v3/projects/9a20d0f8f4004342b448ce4e91cd1e28` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:42.598333 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a20d0f8f4004342b448ce4e91cd1e28)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:42.600480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:42.647152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a20d0f8f4004342b448ce4e91cd1e28', 'request_id': 'req-358c5a6c-764a-4421-876f-49293220c303'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.655382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a20d0f8f4004342b448ce4e91cd1e28', 'request_id': 'req-358c5a6c-764a-4421-876f-49293220c303'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.661639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a20d0f8f4004342b448ce4e91cd1e28', 'request_id': 'req-358c5a6c-764a-4421-876f-49293220c303'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.673836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] The token cache is being invalidate because project 9a20d0f8f4004342b448ce4e91cd1e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:42.674127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.674821 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.676311 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1388/2779] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:42 2022] DELETE /identity/v3/projects/9a20d0f8f4004342b448ce4e91cd1e28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:42.680368 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:42.690189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d3af4-a42e-4862-acc0-e5c6f74177d7 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:42.709199 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:42.752419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:42.753057 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:42.753403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:42.753682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] PATH_INFO: `/v3/users/465e14b970ca49dcb2babc256a2a7496` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:42.754837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=465e14b970ca49dcb2babc256a2a7496)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:42.756774 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:42.811053 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465e14b970ca49dcb2babc256a2a7496'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.825258 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465e14b970ca49dcb2babc256a2a7496'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.832510 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465e14b970ca49dcb2babc256a2a7496'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.833477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465e14b970ca49dcb2babc256a2a7496'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.841630 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-33bf050a-df2a-4abc-b605-5f2ec50f9a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465e14b970ca49dcb2babc256a2a7496'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:42.848243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1392/2780] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:42 2022] DELETE /identity/v3/users/465e14b970ca49dcb2babc256a2a7496 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:43.143054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.144599 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:43.160051 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c5a6c-764a-4421-876f-49293220c303 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.218731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.219316 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.219607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.219872 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] PATH_INFO: `/v3/projects/ff8af73c693a4ad2b6558f23bddf1047` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.220986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8af73c693a4ad2b6558f23bddf1047)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.222943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.254453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:43.272600 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8af73c693a4ad2b6558f23bddf1047', 'request_id': 'req-ae9469c7-4697-4aa0-9cd4-91e579d84341'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:43.280542 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8af73c693a4ad2b6558f23bddf1047', 'request_id': 'req-ae9469c7-4697-4aa0-9cd4-91e579d84341'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:43.286914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8af73c693a4ad2b6558f23bddf1047', 'request_id': 'req-ae9469c7-4697-4aa0-9cd4-91e579d84341'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:43.298656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] The token cache is being invalidate because project ff8af73c693a4ad2b6558f23bddf1047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:43.298953 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:43.299610 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae9469c7-4697-4aa0-9cd4-91e579d84341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:43.301129 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1389/2781] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:43 2022] DELETE /identity/v3/projects/ff8af73c693a4ad2b6558f23bddf1047 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:43.305975 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66fa3c-fc0a-4a26-a8b1-0f4c164269a5 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.306469 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66fa3c-fc0a-4a26-a8b1-0f4c164269a5 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.306598 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66fa3c-fc0a-4a26-a8b1-0f4c164269a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.327407 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-fa66fa3c-fc0a-4a26-a8b1-0f4c164269a5 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:43.328614 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-fa66fa3c-fc0a-4a26-a8b1-0f4c164269a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:43.387775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1393/2782] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:43.395685 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6de85-f7bc-49f3-b09d-f9ce18334ce6 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.395970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6de85-f7bc-49f3-b09d-f9ce18334ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.396242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6de85-f7bc-49f3-b09d-f9ce18334ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.416081 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-a4b6de85-f7bc-49f3-b09d-f9ce18334ce6 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:43.418086 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a4b6de85-f7bc-49f3-b09d-f9ce18334ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:43.426018 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1390/2783] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:43.430197 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66fa3c-fc0a-4a26-a8b1-0f4c164269a5 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.440523 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66fa3c-fc0a-4a26-a8b1-0f4c164269a5 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.445051 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.445640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.445919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.446300 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.446888 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:40:43.447186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.448883 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.463042 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1394/2784] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:40:43.467894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6de85-f7bc-49f3-b09d-f9ce18334ce6 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.477185 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6de85-f7bc-49f3-b09d-f9ce18334ce6 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.482677 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.483278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.483555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.483828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.484480 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.486387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.513132 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1391/2785] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:43 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:43.517415 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.527849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33539637-28d4-4b23-a294-20ef07da3fb2 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.553261 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:43.586127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.586786 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.587063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.587605 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.588242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.591322 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.619446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1395/2786] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:43 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:43.623593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.634061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e8a97-7272-4246-a3bd-65f575053f10 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.639857 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.640470 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.640747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.641020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.641658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.643281 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.654130 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1392/2787] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:43.658297 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.669336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf475977-260b-4e2f-bd48-dbe128ca7c21 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.673867 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dbc07-03a6-416c-980b-2883045be36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.674507 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dbc07-03a6-416c-980b-2883045be36f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.674801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dbc07-03a6-416c-980b-2883045be36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.675073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dbc07-03a6-416c-980b-2883045be36f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.675712 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dbc07-03a6-416c-980b-2883045be36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.677293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dbc07-03a6-416c-980b-2883045be36f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.688211 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1396/2788] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:43.692408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.702306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d90c7b-63d8-4157-ba45-f962b3565a1e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.706831 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.707459 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.707734 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.708003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] PATH_INFO: `/v3/projects/d3ea2f14942d451a9a9af5b7cc453f71/users/35df62084cdd4c8d96b10b7f9b288400/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.722965 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ea2f14942d451a9a9af5b7cc453f71, user_id=35df62084cdd4c8d96b10b7f9b288400, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.725792 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.738890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1393/2789] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:43 2022] PUT /identity/v3/projects/d3ea2f14942d451a9a9af5b7cc453f71/users/35df62084cdd4c8d96b10b7f9b288400/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:43.750493 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967a40-e6b9-4069-990f-fa4ec3d1c1f3 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.750775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967a40-e6b9-4069-990f-fa4ec3d1c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.751047 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40967a40-e6b9-4069-990f-fa4ec3d1c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.778933 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-40967a40-e6b9-4069-990f-fa4ec3d1c1f3 None None] MFA Rules not processed for user `35df62084cdd4c8d96b10b7f9b288400`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:43.780163 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-40967a40-e6b9-4069-990f-fa4ec3d1c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:43.847935 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1397/2790] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:43.852462 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.919555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f68130-d4a6-4762-be7a-201ee271111f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:43.925182 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:43.926303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:43.926594 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:43.928181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:43.928181 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:43.929738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:43.964019 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1394/2791] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:43 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:43.965811 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967a40-e6b9-4069-990f-fa4ec3d1c1f3 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:43.976733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40967a40-e6b9-4069-990f-fa4ec3d1c1f3 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.035526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.036512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.036699 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.036979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.037772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.039796 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.066180 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1398/2792] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:43 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:40:44.076219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.091111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb4b98-8ba8-4393-956d-23b19a715249 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.096263 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.096986 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.097275 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.097546 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.098198 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.099836 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.111647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1395/2793] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:44.117488 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.129451 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee27fb-72fd-4d4a-8692-48c7df9bc36e admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.134232 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.134922 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.135201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.135479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] PATH_INFO: `/v3/projects/3e4a5954fc2947139aaa15b7a79b52f8/users/a6b857cee45349edbcd10c9305988a9a/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.153911 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4a5954fc2947139aaa15b7a79b52f8, user_id=a6b857cee45349edbcd10c9305988a9a, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.156617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.175253 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1399/2794] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:44 2022] PUT /identity/v3/projects/3e4a5954fc2947139aaa15b7a79b52f8/users/a6b857cee45349edbcd10c9305988a9a/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:44.180024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.192604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dbe30-87cb-4683-b34d-3032245950f8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.216915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:44.274021 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28530fd0-8e5b-420b-9a6f-219aaccc0116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.274666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28530fd0-8e5b-420b-9a6f-219aaccc0116 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.274944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28530fd0-8e5b-420b-9a6f-219aaccc0116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.275215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28530fd0-8e5b-420b-9a6f-219aaccc0116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.275866 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28530fd0-8e5b-420b-9a6f-219aaccc0116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.277507 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28530fd0-8e5b-420b-9a6f-219aaccc0116 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.287823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1396/2795] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:44.292160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.297742 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:44.306834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6c3d-7021-4b3a-8ad8-1127b8508b9a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.314852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.315532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.315820 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.316098 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] PATH_INFO: `/v3/projects/3e4a5954fc2947139aaa15b7a79b52f8/users/a6b857cee45349edbcd10c9305988a9a/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.318039 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4a5954fc2947139aaa15b7a79b52f8, user_id=a6b857cee45349edbcd10c9305988a9a, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.320764 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.335249 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1400/2796] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:44 2022] PUT /identity/v3/projects/3e4a5954fc2947139aaa15b7a79b52f8/users/a6b857cee45349edbcd10c9305988a9a/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:44.345926 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8564d-c2a9-4ceb-b0f4-e03e0bf993b2 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.346231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8564d-c2a9-4ceb-b0f4-e03e0bf993b2 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.346532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8564d-c2a9-4ceb-b0f4-e03e0bf993b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.377215 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-bcb8564d-c2a9-4ceb-b0f4-e03e0bf993b2 None None] MFA Rules not processed for user `a6b857cee45349edbcd10c9305988a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:44.378475 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-bcb8564d-c2a9-4ceb-b0f4-e03e0bf993b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:44.453296 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1397/2797] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:44.465539 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.467629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:44.538443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faef076-be28-4243-81ce-32b957456195 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.542195 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.543006 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.543283 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.543569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.552950 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.554417 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.565387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1401/2798] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:44.648259 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8564d-c2a9-4ceb-b0f4-e03e0bf993b2 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:44.658223 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8564d-c2a9-4ceb-b0f4-e03e0bf993b2 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:44.662090 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a08d4c-5fb4-443a-b0fa-e037866285af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:44.662731 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08d4c-5fb4-443a-b0fa-e037866285af service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:44.663009 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08d4c-5fb4-443a-b0fa-e037866285af service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:44.663280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a08d4c-5fb4-443a-b0fa-e037866285af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:44.723407 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a08d4c-5fb4-443a-b0fa-e037866285af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:44.724802 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a08d4c-5fb4-443a-b0fa-e037866285af service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:44.734891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1398/2799] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:50.903517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:50.978334 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098156e5-b529-4975-9751-5ee36383484e service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:50.983442 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:50.984078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:50.984353 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:50.984629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] PATH_INFO: `/v3/users/35df62084cdd4c8d96b10b7f9b288400` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:50.985853 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=35df62084cdd4c8d96b10b7f9b288400)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:50.987849 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:51.037369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35df62084cdd4c8d96b10b7f9b288400'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.050768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35df62084cdd4c8d96b10b7f9b288400'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.057844 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35df62084cdd4c8d96b10b7f9b288400'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.058617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35df62084cdd4c8d96b10b7f9b288400'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.066894 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35df62084cdd4c8d96b10b7f9b288400'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.073181 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1402/2800] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:50 2022] DELETE /identity/v3/users/35df62084cdd4c8d96b10b7f9b288400 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:51.078651 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:51.079151 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:51.079261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:51.100589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:51.101813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:51.147056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:51.167795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1399/2801] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:51.177238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:51.178768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:51.192383 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:51.242556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23731ca-3182-4a7c-903a-342048ec5bea admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:51.246289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:51.246903 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:51.247184 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:51.247457 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:51.257317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:51.258819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:51.270594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1403/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:51.553933 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:51.555529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:51.569891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269616e-7bf5-43ab-a715-23b451bee8a7 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:51.576554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:51.577378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:51.577664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:51.577959 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] PATH_INFO: `/v3/projects/d3ea2f14942d451a9a9af5b7cc453f71` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:51.579088 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ea2f14942d451a9a9af5b7cc453f71)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:51.580993 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:51.631759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ea2f14942d451a9a9af5b7cc453f71', 'request_id': 'req-715c2f64-db28-408f-8207-57d82911ae4b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.639858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ea2f14942d451a9a9af5b7cc453f71', 'request_id': 'req-715c2f64-db28-408f-8207-57d82911ae4b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.646419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ea2f14942d451a9a9af5b7cc453f71', 'request_id': 'req-715c2f64-db28-408f-8207-57d82911ae4b'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.657684 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] The token cache is being invalidate because project d3ea2f14942d451a9a9af5b7cc453f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:51.657970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.658639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.660323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1400/2803] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:51 2022] DELETE /identity/v3/projects/d3ea2f14942d451a9a9af5b7cc453f71 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:51.664481 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:51.675607 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0dfe7-acbc-429c-8852-6907fb1b3422 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:51.740046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:51.740875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:51.741254 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:51.741543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] PATH_INFO: `/v3/users/a6b857cee45349edbcd10c9305988a9a` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:51.742789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b857cee45349edbcd10c9305988a9a)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:51.744743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:51.791244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b857cee45349edbcd10c9305988a9a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.805501 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b857cee45349edbcd10c9305988a9a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.813414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b857cee45349edbcd10c9305988a9a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.814356 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b857cee45349edbcd10c9305988a9a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.821919 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-098f399c-c7f7-4695-9baf-a9d91731010b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b857cee45349edbcd10c9305988a9a'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:51.829335 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1404/2804] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:51 2022] DELETE /identity/v3/users/a6b857cee45349edbcd10c9305988a9a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:52.122590 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.124629 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:52.141894 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2f64-db28-408f-8207-57d82911ae4b admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.202063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.202727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.203007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.203280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] PATH_INFO: `/v3/projects/3e4a5954fc2947139aaa15b7a79b52f8` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.204399 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4a5954fc2947139aaa15b7a79b52f8)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.206344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.255777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4a5954fc2947139aaa15b7a79b52f8', 'request_id': 'req-c043f53d-5b6c-4a1e-a749-956f1e245e0a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:52.263221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4a5954fc2947139aaa15b7a79b52f8', 'request_id': 'req-c043f53d-5b6c-4a1e-a749-956f1e245e0a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:52.269513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4a5954fc2947139aaa15b7a79b52f8', 'request_id': 'req-c043f53d-5b6c-4a1e-a749-956f1e245e0a'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:52.275878 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:52.282172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] The token cache is being invalidate because project 3e4a5954fc2947139aaa15b7a79b52f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:52.282647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:52.283756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-c043f53d-5b6c-4a1e-a749-956f1e245e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:52.285221 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1401/2805] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:52 2022] DELETE /identity/v3/projects/3e4a5954fc2947139aaa15b7a79b52f8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:52.290137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0056b9-2640-4de1-bbf8-aae6150749a8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.290615 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0056b9-2640-4de1-bbf8-aae6150749a8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.290698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0056b9-2640-4de1-bbf8-aae6150749a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.309775 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-6c0056b9-2640-4de1-bbf8-aae6150749a8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:52.310994 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6c0056b9-2640-4de1-bbf8-aae6150749a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:52.340472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:52.372543 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1405/2806] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:40:52.381561 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b836-ce54-4742-9e23-0dde3a6d0fa3 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.381845 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b836-ce54-4742-9e23-0dde3a6d0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.382122 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7b836-ce54-4742-9e23-0dde3a6d0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.405165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-53c7b836-ce54-4742-9e23-0dde3a6d0fa3 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:52.406349 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-53c7b836-ce54-4742-9e23-0dde3a6d0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:52.414345 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1402/2807] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:52.418715 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0056b9-2640-4de1-bbf8-aae6150749a8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.428504 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0056b9-2640-4de1-bbf8-aae6150749a8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.433380 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.433984 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.434289 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.434562 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.435208 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:40:52.435508 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.437129 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.449629 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1406/2808] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:40:52.454063 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7b836-ce54-4742-9e23-0dde3a6d0fa3 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.464535 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7b836-ce54-4742-9e23-0dde3a6d0fa3 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.469367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.470004 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.470310 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.470586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.471237 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.473153 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.502918 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1403/2809] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:52 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:40:52.507411 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.518522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b9a61-b886-4cd1-a8cf-165470f480ac admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.578336 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.579176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.579462 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.579737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.580408 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.582393 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.607866 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1407/2810] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:52 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:52.612253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.625712 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbef22-797c-4be6-b75a-c2acd91c8a0a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.630425 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.631031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.631309 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.631579 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.632226 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.633804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.645756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1404/2811] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:52.649885 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.661142 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426bab-7cf6-4470-b4ae-92202cf70e4b admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.665850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405855e7-87de-4ccc-92aa-28f697a77cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.666514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405855e7-87de-4ccc-92aa-28f697a77cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.667186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405855e7-87de-4ccc-92aa-28f697a77cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.667517 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405855e7-87de-4ccc-92aa-28f697a77cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.668192 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405855e7-87de-4ccc-92aa-28f697a77cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.669801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405855e7-87de-4ccc-92aa-28f697a77cbf admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.681567 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1408/2812] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:52.686455 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.697007 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bda082-0427-4ccb-a0ef-cd660bcae230 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.702547 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.703236 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.703972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.703972 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] PATH_INFO: `/v3/projects/e608091ffe1a4d9aaf5a057f41d5756e/users/6cd94d52050b44309503bb11ad691511/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.720106 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e608091ffe1a4d9aaf5a057f41d5756e, user_id=6cd94d52050b44309503bb11ad691511, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.722910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.736520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1405/2813] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:52 2022] PUT /identity/v3/projects/e608091ffe1a4d9aaf5a057f41d5756e/users/6cd94d52050b44309503bb11ad691511/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:52.749744 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dbd5b-8dec-45d8-8ee0-9405e4974f6b None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.750035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dbd5b-8dec-45d8-8ee0-9405e4974f6b None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.750341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dbd5b-8dec-45d8-8ee0-9405e4974f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.785127 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-b25dbd5b-8dec-45d8-8ee0-9405e4974f6b None None] MFA Rules not processed for user `6cd94d52050b44309503bb11ad691511`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:52.786556 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-b25dbd5b-8dec-45d8-8ee0-9405e4974f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:52.866422 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1409/2814] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:52.874605 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.941114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aeee9-d05c-4344-b6f9-cded93307ab4 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:52.946003 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:52.946737 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:52.947084 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:52.947430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:52.948356 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:52.950368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:52.983020 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1406/2815] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:52 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:52.984472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dbd5b-8dec-45d8-8ee0-9405e4974f6b None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:52.995960 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dbd5b-8dec-45d8-8ee0-9405e4974f6b None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.021044 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:53.052500 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.053107 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.053390 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.053664 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.054341 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.056263 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.080783 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1410/2816] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:52 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:53.082234 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:53.093140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e810e-f52d-4ca6-8c91-4cd1644bfdec admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.097944 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.098583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.098867 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.099144 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.099820 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.101409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.112533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1407/2817] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:53.116948 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:53.127656 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68734f29-7993-4e67-be7e-932017dc74cc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.132239 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.132905 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.133177 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.133424 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] PATH_INFO: `/v3/projects/9d36387e84ce48c7980ec2e3f2385e5b/users/462d6860b9ff42e38794c472998b9c53/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.148023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d36387e84ce48c7980ec2e3f2385e5b, user_id=462d6860b9ff42e38794c472998b9c53, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.150838 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.164949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1411/2818] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:53 2022] PUT /identity/v3/projects/9d36387e84ce48c7980ec2e3f2385e5b/users/462d6860b9ff42e38794c472998b9c53/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:40:53.169572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:53.179985 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659424a-86fd-4b71-b884-cef3667e8bcf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.240253 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb611d00-63ac-46dc-9fa4-0bdfe3b234f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.240777 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb611d00-63ac-46dc-9fa4-0bdfe3b234f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.241055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb611d00-63ac-46dc-9fa4-0bdfe3b234f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.241326 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb611d00-63ac-46dc-9fa4-0bdfe3b234f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.241975 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb611d00-63ac-46dc-9fa4-0bdfe3b234f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.243589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb611d00-63ac-46dc-9fa4-0bdfe3b234f7 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.253287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1408/2819] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:53.257554 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:53.268378 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769391c-f25a-4bd2-91cc-05489d181aff admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.273028 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.273679 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.273959 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.274231 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] PATH_INFO: `/v3/projects/9d36387e84ce48c7980ec2e3f2385e5b/users/462d6860b9ff42e38794c472998b9c53/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.276794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d36387e84ce48c7980ec2e3f2385e5b, user_id=462d6860b9ff42e38794c472998b9c53, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.279705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.289966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1412/2820] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:53 2022] PUT /identity/v3/projects/9d36387e84ce48c7980ec2e3f2385e5b/users/462d6860b9ff42e38794c472998b9c53/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:53.301196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1b17-6c1d-43c4-8ea2-46c94aff3328 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.301476 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1b17-6c1d-43c4-8ea2-46c94aff3328 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.301747 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1b17-6c1d-43c4-8ea2-46c94aff3328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.310079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:53.338220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6dda1b17-6c1d-43c4-8ea2-46c94aff3328 None None] MFA Rules not processed for user `462d6860b9ff42e38794c472998b9c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:53.340139 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6dda1b17-6c1d-43c4-8ea2-46c94aff3328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:53.408053 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1409/2821] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:53.420157 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:53.422110 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:53.481240 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c7f57-e58a-464a-9b6d-b09c97c3be66 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.484887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a214cad-e58e-4c86-9ca9-c574162fc533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.485555 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214cad-e58e-4c86-9ca9-c574162fc533 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.485772 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214cad-e58e-4c86-9ca9-c574162fc533 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.486045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214cad-e58e-4c86-9ca9-c574162fc533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.495564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a214cad-e58e-4c86-9ca9-c574162fc533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.496897 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a214cad-e58e-4c86-9ca9-c574162fc533 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.506306 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1413/2822] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:53.535046 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda1b17-6c1d-43c4-8ea2-46c94aff3328 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:53.599479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda1b17-6c1d-43c4-8ea2-46c94aff3328 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.605738 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.606417 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.606692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.606963 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] PATH_INFO: `/v3/users/6cd94d52050b44309503bb11ad691511` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.608127 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd94d52050b44309503bb11ad691511)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.610055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.660125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd94d52050b44309503bb11ad691511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:53.672189 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd94d52050b44309503bb11ad691511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:53.680559 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd94d52050b44309503bb11ad691511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:53.687875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd94d52050b44309503bb11ad691511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:53.688533 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd94d52050b44309503bb11ad691511'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:53.694360 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1410/2823] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:53 2022] DELETE /identity/v3/users/6cd94d52050b44309503bb11ad691511 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:53.699447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.699751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.700024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.719890 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:53.721119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:53.780814 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1414/2824] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:53.790534 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:53.791927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:53.802683 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:53.853211 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee65126-b575-4e90-b5d8-b5bc30d40a0d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:53.857412 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:53.858054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:53.858381 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:53.858687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:53.868591 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:53.870038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:53.881094 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1411/2825] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:54.192246 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:54.193719 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:54.206759 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b9b4c-2258-4383-b06e-8394e4f5b143 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:54.211482 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:54.212441 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:54.212722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:54.213000 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] PATH_INFO: `/v3/projects/e608091ffe1a4d9aaf5a057f41d5756e` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:54.215020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e608091ffe1a4d9aaf5a057f41d5756e)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:54.217007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:54.245466 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:54.274889 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e608091ffe1a4d9aaf5a057f41d5756e', 'request_id': 'req-969caf05-1102-4662-8bd6-70377cea831d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.283875 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e608091ffe1a4d9aaf5a057f41d5756e', 'request_id': 'req-969caf05-1102-4662-8bd6-70377cea831d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.290648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e608091ffe1a4d9aaf5a057f41d5756e', 'request_id': 'req-969caf05-1102-4662-8bd6-70377cea831d'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.303755 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] The token cache is being invalidate because project e608091ffe1a4d9aaf5a057f41d5756e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:54.303961 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.304631 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.306151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1415/2826] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:54 2022] DELETE /identity/v3/projects/e608091ffe1a4d9aaf5a057f41d5756e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:54.310733 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:54.320435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fe4cb-3b98-458d-8214-589c389cf529 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:54.384031 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:54.384660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:54.384935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:54.385205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] PATH_INFO: `/v3/users/462d6860b9ff42e38794c472998b9c53` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:54.386956 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=462d6860b9ff42e38794c472998b9c53)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:54.388906 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:54.446711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462d6860b9ff42e38794c472998b9c53'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.464957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462d6860b9ff42e38794c472998b9c53'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.474960 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462d6860b9ff42e38794c472998b9c53'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.484067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462d6860b9ff42e38794c472998b9c53'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.484852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-45caf112-0652-4824-b83b-4eee1ac35776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462d6860b9ff42e38794c472998b9c53'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.491643 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1412/2827] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:40:54 2022] DELETE /identity/v3/users/462d6860b9ff42e38794c472998b9c53 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:54.778996 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:54.780540 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:54.796400 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969caf05-1102-4662-8bd6-70377cea831d admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:54.861572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:54.862259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:54.862533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:54.862810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] PATH_INFO: `/v3/projects/9d36387e84ce48c7980ec2e3f2385e5b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:54.863944 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d36387e84ce48c7980ec2e3f2385e5b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:54.865877 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:54.918023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d36387e84ce48c7980ec2e3f2385e5b', 'request_id': 'req-ce1a1391-df9b-4413-9741-e1e2365b5bd7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.926678 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d36387e84ce48c7980ec2e3f2385e5b', 'request_id': 'req-ce1a1391-df9b-4413-9741-e1e2365b5bd7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.935527 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d36387e84ce48c7980ec2e3f2385e5b', 'request_id': 'req-ce1a1391-df9b-4413-9741-e1e2365b5bd7'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.949113 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] The token cache is being invalidate because project 9d36387e84ce48c7980ec2e3f2385e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:40:54.949401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.950066 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-ce1a1391-df9b-4413-9741-e1e2365b5bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:40:54.951627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1416/2828] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:40:54 2022] DELETE /identity/v3/projects/9d36387e84ce48c7980ec2e3f2385e5b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:54.956512 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d04a7-06ad-4740-bd5d-fefc7d84a3e4 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:54.956801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d04a7-06ad-4740-bd5d-fefc7d84a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:54.957079 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d04a7-06ad-4740-bd5d-fefc7d84a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:54.977572 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-701d04a7-06ad-4740-bd5d-fefc7d84a3e4 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:54.978812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-701d04a7-06ad-4740-bd5d-fefc7d84a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:55.005532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:55.041941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1413/2829] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:55.050650 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b05ff-7ca8-4447-9234-56ab8b359ca8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.050929 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b05ff-7ca8-4447-9234-56ab8b359ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.051203 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b05ff-7ca8-4447-9234-56ab8b359ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.072453 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-ae0b05ff-7ca8-4447-9234-56ab8b359ca8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:55.074423 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ae0b05ff-7ca8-4447-9234-56ab8b359ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:55.083016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1417/2830] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:55.088091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d04a7-06ad-4740-bd5d-fefc7d84a3e4 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.101250 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d04a7-06ad-4740-bd5d-fefc7d84a3e4 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.107368 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.108131 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.108420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.108694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] PATH_INFO: `/v3/domains` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.109355 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81642) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:40:55.109658 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.111321 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.126914 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1414/2831] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:40:55.132293 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b05ff-7ca8-4447-9234-56ab8b359ca8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.142007 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b05ff-7ca8-4447-9234-56ab8b359ca8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.146999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.147665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.148008 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.148314 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.149013 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.151040 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.183826 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1418/2832] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:55 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:55.187848 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.199103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67d1f3-a3e9-47b8-88f3-d4edd6aaa4af admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.257062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.257659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.257932 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.258280 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.258893 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.260994 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.281267 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1415/2833] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:55 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:55.285401 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.297739 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229566a3-c4d8-4062-be1d-e54e6cb97045 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.302509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.303065 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.303357 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.303627 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.304268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.305865 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.309077 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:55.319936 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1419/2834] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:40:55.324169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.334121 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de991d5-eeef-4c8a-98f7-0b61935f45ce admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.339278 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24062277-78db-44f3-80c1-f75c873c8ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.339871 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24062277-78db-44f3-80c1-f75c873c8ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.340150 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24062277-78db-44f3-80c1-f75c873c8ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.340421 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24062277-78db-44f3-80c1-f75c873c8ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.341062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24062277-78db-44f3-80c1-f75c873c8ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.342716 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24062277-78db-44f3-80c1-f75c873c8ae8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.353196 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1416/2835] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:55.357819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.367751 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271c366-5277-4b4e-87dc-7e178fd999ed admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.372968 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.373604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.373880 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.374151 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] PATH_INFO: `/v3/projects/23e0a0e27d3c46c7b3c63c79bc66f9f7/users/149d241e47164779a5040daa4669aa7c/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.388810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e0a0e27d3c46c7b3c63c79bc66f9f7, user_id=149d241e47164779a5040daa4669aa7c, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.391189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.403979 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1420/2836] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:55 2022] PUT /identity/v3/projects/23e0a0e27d3c46c7b3c63c79bc66f9f7/users/149d241e47164779a5040daa4669aa7c/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:55.414103 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91024d58-185e-4929-9858-94111640105a None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.414448 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91024d58-185e-4929-9858-94111640105a None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.414750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91024d58-185e-4929-9858-94111640105a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.445068 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-91024d58-185e-4929-9858-94111640105a None None] MFA Rules not processed for user `149d241e47164779a5040daa4669aa7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:55.446393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-91024d58-185e-4929-9858-94111640105a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:55.516165 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1417/2837] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:55.520642 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.584134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22bbca-dee0-45c7-ab79-ba1a7a735d24 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.590219 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.590887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.591173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.591445 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.592076 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.594643 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.623292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1421/2838] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:40:55 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:55.627879 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91024d58-185e-4929-9858-94111640105a None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.639268 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91024d58-185e-4929-9858-94111640105a None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.663660 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:55.697097 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.697702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.698010 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.698277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] PATH_INFO: `/v3/users` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.698911 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.700865 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.722852 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1418/2839] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:40:55 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:40:55.726855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.738162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f0160-366c-44d9-998b-076f2d2d11fc admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.742938 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.743532 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.743813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.744085 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.744729 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.746667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.757609 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1422/2840] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:55.761771 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.771711 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e9344a-4ab5-4cbb-a35a-508bfa88500a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.777146 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.777782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.778062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.778367 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] PATH_INFO: `/v3/projects/053cf48633044dbd8cc9539dab5e38da/users/b052313fdde7414db5982ecc73c06d51/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.793344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=053cf48633044dbd8cc9539dab5e38da, user_id=b052313fdde7414db5982ecc73c06d51, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.796037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.811970 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1419/2841] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:55 2022] PUT /identity/v3/projects/053cf48633044dbd8cc9539dab5e38da/users/b052313fdde7414db5982ecc73c06d51/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 08:40:55.815954 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.826494 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42917f-d43f-46f5-aedd-1b365927a96f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.883392 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881cf19-590d-42a3-ba62-e5e42c720e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.883923 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881cf19-590d-42a3-ba62-e5e42c720e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.884201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881cf19-590d-42a3-ba62-e5e42c720e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.884479 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881cf19-590d-42a3-ba62-e5e42c720e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.885183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881cf19-590d-42a3-ba62-e5e42c720e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.887939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881cf19-590d-42a3-ba62-e5e42c720e31 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.898259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1423/2842] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:40:55.903203 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:55.914839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d4d0b-bdda-4895-affe-b33900af8365 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:55.920128 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:55.920793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.921074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.921354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] PATH_INFO: `/v3/projects/053cf48633044dbd8cc9539dab5e38da/users/b052313fdde7414db5982ecc73c06d51/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.923375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] RBAC: Authorizing `identity:create_grant(project_id=053cf48633044dbd8cc9539dab5e38da, user_id=b052313fdde7414db5982ecc73c06d51, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:55.926034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:55.937389 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1420/2843] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:40:55 2022] PUT /identity/v3/projects/053cf48633044dbd8cc9539dab5e38da/users/b052313fdde7414db5982ecc73c06d51/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:40:55.948362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5ebbf-6f59-421e-b870-49f987d281f2 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:55.949235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5ebbf-6f59-421e-b870-49f987d281f2 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:55.949235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5ebbf-6f59-421e-b870-49f987d281f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:55.980731 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d0e5ebbf-6f59-421e-b870-49f987d281f2 None None] MFA Rules not processed for user `b052313fdde7414db5982ecc73c06d51`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:40:55.981983 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d0e5ebbf-6f59-421e-b870-49f987d281f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:56.016688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:40:56.056520 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1424/2844] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:40:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:40:56.067877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:56.069622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:40:56.128859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84cda8-3683-4f04-aae2-a2aa3c4d5abf admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:56.132631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a582f0-d4a4-4485-b8f8-57035dc11125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:56.133243 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a582f0-d4a4-4485-b8f8-57035dc11125 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:56.133575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a582f0-d4a4-4485-b8f8-57035dc11125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:56.133791 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a582f0-d4a4-4485-b8f8-57035dc11125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:56.144375 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a582f0-d4a4-4485-b8f8-57035dc11125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:56.145815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a582f0-d4a4-4485-b8f8-57035dc11125 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:56.157786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1421/2845] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:40:56.252063 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5ebbf-6f59-421e-b870-49f987d281f2 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:40:56.267387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5ebbf-6f59-421e-b870-49f987d281f2 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:40:56.271839 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:40:56.272789 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:40:56.273164 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:40:56.273550 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:40:56.335904 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:40:56.337617 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:40:56.346858 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1425/2846] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:40:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:00.508363 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055d31-8686-4cb1-8d8a-7bcdeb116520 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.508876 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055d31-8686-4cb1-8d8a-7bcdeb116520 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.508983 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055d31-8686-4cb1-8d8a-7bcdeb116520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.576741 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-5d055d31-8686-4cb1-8d8a-7bcdeb116520 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:00.577962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-5d055d31-8686-4cb1-8d8a-7bcdeb116520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:00.630451 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:00.656293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1422/2847] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Sep 1 08:41:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:00.708503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:00.709939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:00.807895 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e280a-efbd-432e-8721-d09aa4d50ea6 service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:00.813187 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6b32e-afd8-4ee7-aa11-762fd3b80f40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:00.813802 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b32e-afd8-4ee7-aa11-762fd3b80f40 service swift] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:00.814086 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b32e-afd8-4ee7-aa11-762fd3b80f40 service swift] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:00.814396 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6b32e-afd8-4ee7-aa11-762fd3b80f40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:00.823987 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6b32e-afd8-4ee7-aa11-762fd3b80f40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:00.825601 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6b32e-afd8-4ee7-aa11-762fd3b80f40 service swift] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:00.834661 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1426/2848] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:41:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:41:01.265813 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055d31-8686-4cb1-8d8a-7bcdeb116520 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:01.344900 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055d31-8686-4cb1-8d8a-7bcdeb116520 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:01.350441 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:01.351054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.351348 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.351598 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] PATH_INFO: `/v3/users/149d241e47164779a5040daa4669aa7c` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.352760 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149d241e47164779a5040daa4669aa7c)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:01.355453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:01.447497 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149d241e47164779a5040daa4669aa7c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.471843 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149d241e47164779a5040daa4669aa7c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.494935 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149d241e47164779a5040daa4669aa7c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.506613 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149d241e47164779a5040daa4669aa7c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.507402 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149d241e47164779a5040daa4669aa7c'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:01.520420 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1423/2849] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:01 2022] DELETE /identity/v3/users/149d241e47164779a5040daa4669aa7c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:01.522855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.522855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.522855 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.551403 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:01.552753 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:01.614566 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=100 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:01.663126 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1427/2850] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:01.675318 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:01.677859 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:01.817665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0f744-60a9-45cf-a51c-90b106a1f926 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:01.822340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:01.823536 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:01.823799 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:01.824206 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:01.835586 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:01.837323 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:01.856768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1424/2851] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:02.250133 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.252194 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:02.289196 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8ddf-4659-4e0f-846a-c6f08e35d414 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.305981 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.308276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.309084 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.310095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] PATH_INFO: `/v3/projects/23e0a0e27d3c46c7b3c63c79bc66f9f7` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.312537 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e0a0e27d3c46c7b3c63c79bc66f9f7)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.314851 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.385737 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e0a0e27d3c46c7b3c63c79bc66f9f7', 'request_id': 'req-e5f324af-dd74-4b0a-a259-e4daf4076958'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.397201 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e0a0e27d3c46c7b3c63c79bc66f9f7', 'request_id': 'req-e5f324af-dd74-4b0a-a259-e4daf4076958'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.405616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e0a0e27d3c46c7b3c63c79bc66f9f7', 'request_id': 'req-e5f324af-dd74-4b0a-a259-e4daf4076958'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.423045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] The token cache is being invalidate because project 23e0a0e27d3c46c7b3c63c79bc66f9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81643) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:02.423914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.424752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.426667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1428/2852] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:02 2022] DELETE /identity/v3/projects/23e0a0e27d3c46c7b3c63c79bc66f9f7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:02.430525 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.446264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bc7c8-75f9-4767-b9e9-bf37e405e861 service neutron] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:02.455949 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:02.555396 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:02.556682 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:02.557895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:02.558410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] PATH_INFO: `/v3/users/b052313fdde7414db5982ecc73c06d51` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:02.559759 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b052313fdde7414db5982ecc73c06d51)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:02.561756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:02.624978 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b052313fdde7414db5982ecc73c06d51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.643809 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b052313fdde7414db5982ecc73c06d51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.655143 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b052313fdde7414db5982ecc73c06d51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.673652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b052313fdde7414db5982ecc73c06d51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.674751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b052313fdde7414db5982ecc73c06d51'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:02.692474 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1425/2853] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:02 2022] DELETE /identity/v3/users/b052313fdde7414db5982ecc73c06d51 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:02.825352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:02.826837 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:02.953807 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f324af-dd74-4b0a-a259-e4daf4076958 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.045163 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.047453 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:03.050669 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:03.067316 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece669a0-afde-4527-9a8c-7106730cede1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a545f5fde0d432fbe31819eb5c7c39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.067946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece669a0-afde-4527-9a8c-7106730cede1 service nova] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.068436 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece669a0-afde-4527-9a8c-7106730cede1 service nova] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.068718 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece669a0-afde-4527-9a8c-7106730cede1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.071073 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-ece669a0-afde-4527-9a8c-7106730cede1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:03.178137 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece669a0-afde-4527-9a8c-7106730cede1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.180788 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece669a0-afde-4527-9a8c-7106730cede1 service nova] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.193623 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359f0c0-e530-4e44-908b-5ea8db57e329 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.202548 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.203798 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.204220 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.204597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] PATH_INFO: `/v3/projects/053cf48633044dbd8cc9539dab5e38da` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.205024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1429/2854] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:03.216875 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=053cf48633044dbd8cc9539dab5e38da)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.218877 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.264172 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:03.298942 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '053cf48633044dbd8cc9539dab5e38da', 'request_id': 'req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:03.311828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '053cf48633044dbd8cc9539dab5e38da', 'request_id': 'req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:03.324689 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '053cf48633044dbd8cc9539dab5e38da', 'request_id': 'req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:03.338479 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] The token cache is being invalidate because project 053cf48633044dbd8cc9539dab5e38da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:03.339180 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:03.340393 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-2782c0d1-061d-4d6e-bfc5-dea7d8d62ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:03.344406 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1426/2855] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:03 2022] DELETE /identity/v3/projects/053cf48633044dbd8cc9539dab5e38da => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:03.350333 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22177ff-ed6f-4e02-8b68-6cd4b4561764 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.351105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22177ff-ed6f-4e02-8b68-6cd4b4561764 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.351105 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22177ff-ed6f-4e02-8b68-6cd4b4561764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.407367 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-a22177ff-ed6f-4e02-8b68-6cd4b4561764 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:03.408893 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-a22177ff-ed6f-4e02-8b68-6cd4b4561764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:03.499162 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1430/2856] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:03.511365 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c0c3-5b73-46da-adf7-d5805463bd5d None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.511659 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c0c3-5b73-46da-adf7-d5805463bd5d None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.511973 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c0c3-5b73-46da-adf7-d5805463bd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.534188 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8d28c0c3-5b73-46da-adf7-d5805463bd5d None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:03.535698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8d28c0c3-5b73-46da-adf7-d5805463bd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:03.545828 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1427/2857] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:03.552202 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22177ff-ed6f-4e02-8b68-6cd4b4561764 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.565896 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22177ff-ed6f-4e02-8b68-6cd4b4561764 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.571915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.572594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.573037 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.573389 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.574228 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:41:03.574561 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.576285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.608705 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1431/2858] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 08:41:03.615058 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c0c3-5b73-46da-adf7-d5805463bd5d None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.636517 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c0c3-5b73-46da-adf7-d5805463bd5d None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.641231 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.641922 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.642194 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.642583 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.643252 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.645577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.708913 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1428/2859] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:41:03 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 08:41:03.715708 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.727132 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da9cdd-0408-4294-bd47-33182703b39f admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.812862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.812862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.813221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.814649 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.816259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.820660 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.871061 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.874446 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1432/2860] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:41:03 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:03.887957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89a544-c951-4310-a6bc-0b0b4732aba8 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.896199 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.897941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.899054 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.899454 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.900511 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.902943 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.921761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1429/2861] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:41:03.922830 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.934414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844a646-543c-4b63-85a4-2dcd7d32ffa8 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:03.945094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51526d-5875-4996-8e5a-182f5dc13cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:03.946078 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51526d-5875-4996-8e5a-182f5dc13cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:03.946473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51526d-5875-4996-8e5a-182f5dc13cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:03.946862 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51526d-5875-4996-8e5a-182f5dc13cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:03.947928 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51526d-5875-4996-8e5a-182f5dc13cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:03.951251 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51526d-5875-4996-8e5a-182f5dc13cc8 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:03.966572 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1433/2862] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:41:03.975242 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:03.987617 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628127c-733b-456b-a824-362c39ecae3a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.000312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.001149 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.001595 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.001937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] PATH_INFO: `/v3/projects/885d49d8aa0743c5a6bffe19bc5f2edc/users/81e717a1ef9d45ac97d1da754c66982c/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.043378 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=885d49d8aa0743c5a6bffe19bc5f2edc, user_id=81e717a1ef9d45ac97d1da754c66982c, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.046518 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.068521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1430/2863] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:41:03 2022] PUT /identity/v3/projects/885d49d8aa0743c5a6bffe19bc5f2edc/users/81e717a1ef9d45ac97d1da754c66982c/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:04.089647 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20385c-2977-4e94-8b7b-eb77e6fbdba8 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.090216 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20385c-2977-4e94-8b7b-eb77e6fbdba8 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.090752 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20385c-2977-4e94-8b7b-eb77e6fbdba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.099171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:04.162765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-4f20385c-2977-4e94-8b7b-eb77e6fbdba8 None None] MFA Rules not processed for user `81e717a1ef9d45ac97d1da754c66982c`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:04.164206 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-4f20385c-2977-4e94-8b7b-eb77e6fbdba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:04.261338 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1434/2864] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:41:04.269611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:04.386530 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b19665-1074-4fc9-8e99-ea6690502b98 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.396890 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.398456 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.399597 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.400228 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.401783 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.412140 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.478614 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1431/2865] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:41:04 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:04.484480 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20385c-2977-4e94-8b7b-eb77e6fbdba8 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:04.500590 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20385c-2977-4e94-8b7b-eb77e6fbdba8 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.632434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.633339 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.633720 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.634096 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.635182 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.638102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.667881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1435/2866] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:41:04 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:04.672075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:04.685952 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0096c14-6b54-4b17-a1d8-11de3789138a admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.695001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.695555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.696195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.697101 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.697437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.700230 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.723430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1432/2867] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:04.725419 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:04.738998 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e2a3b-a6f8-4463-b4eb-b541e2327803 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.744512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.745873 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.746159 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.746651 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] PATH_INFO: `/v3/projects/d3fc36c31e4247719c2e10ff4c556e32/users/ab4ec3cf83984c94a5a04b43316c1861/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.771927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3fc36c31e4247719c2e10ff4c556e32, user_id=ab4ec3cf83984c94a5a04b43316c1861, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.774891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.803035 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1436/2868] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:41:04 2022] PUT /identity/v3/projects/d3fc36c31e4247719c2e10ff4c556e32/users/ab4ec3cf83984c94a5a04b43316c1861/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:04.807589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:04.822195 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba97ff6-4ff5-40c8-be9e-5aaa66438339 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.866289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:04.916017 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc577a-f96b-4869-85a9-cfa7070e334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.918277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc577a-f96b-4869-85a9-cfa7070e334d admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.918277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc577a-f96b-4869-85a9-cfa7070e334d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.918277 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc577a-f96b-4869-85a9-cfa7070e334d admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.919558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc577a-f96b-4869-85a9-cfa7070e334d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.920957 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc577a-f96b-4869-85a9-cfa7070e334d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.933340 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1433/2869] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:04.937915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:04.950472 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9349c-53be-4a3c-97d7-4a11d5569221 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:04.955758 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:04.956582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.956906 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.957259 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] PATH_INFO: `/v3/projects/d3fc36c31e4247719c2e10ff4c556e32/users/ab4ec3cf83984c94a5a04b43316c1861/roles/50ec6d9e36dd45108a0bbacd15fed336` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:04.959387 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3fc36c31e4247719c2e10ff4c556e32, user_id=ab4ec3cf83984c94a5a04b43316c1861, role_id=50ec6d9e36dd45108a0bbacd15fed336)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:04.962468 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:04.989652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1437/2870] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:41:04 2022] PUT /identity/v3/projects/d3fc36c31e4247719c2e10ff4c556e32/users/ab4ec3cf83984c94a5a04b43316c1861/roles/50ec6d9e36dd45108a0bbacd15fed336 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:04.992232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd68c-901f-4544-88ea-f1378be8205e None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:04.993000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd68c-901f-4544-88ea-f1378be8205e None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:04.993427 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd68c-901f-4544-88ea-f1378be8205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:05.031917 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-3d3bd68c-901f-4544-88ea-f1378be8205e None None] MFA Rules not processed for user `ab4ec3cf83984c94a5a04b43316c1861`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:05.034024 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-3d3bd68c-901f-4544-88ea-f1378be8205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:05.139373 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1434/2871] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:05.152243 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:05.154881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:05.219589 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:05.239014 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d45b9-96ae-44a2-9d2b-5bbcff7e82ba admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:05.243024 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:05.243725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:05.244069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:05.244915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:05.256011 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:05.257549 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:05.278568 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1438/2872] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:05.362447 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd68c-901f-4544-88ea-f1378be8205e None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:05.373804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd68c-901f-4544-88ea-f1378be8205e None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:05.377607 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54b8e3-c1c4-4ce2-951c-1f3f3a2e18ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:05.378305 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54b8e3-c1c4-4ce2-951c-1f3f3a2e18ad service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:05.378593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54b8e3-c1c4-4ce2-951c-1f3f3a2e18ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:05.379045 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54b8e3-c1c4-4ce2-951c-1f3f3a2e18ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:05.446210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54b8e3-c1c4-4ce2-951c-1f3f3a2e18ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:05.448520 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54b8e3-c1c4-4ce2-951c-1f3f3a2e18ad service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:05.460647 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1435/2873] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:41:05.816449 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:05.908582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d075f1-696b-4ade-ab8e-b7bc5ff7cbcf service cinder] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:05.917290 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:05.918020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:05.918330 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:05.918606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] PATH_INFO: `/v3/users/81e717a1ef9d45ac97d1da754c66982c` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:05.919887 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e717a1ef9d45ac97d1da754c66982c)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:05.922020 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:06.017112 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e717a1ef9d45ac97d1da754c66982c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.038309 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e717a1ef9d45ac97d1da754c66982c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.052473 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e717a1ef9d45ac97d1da754c66982c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.053503 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e717a1ef9d45ac97d1da754c66982c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.065352 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e717a1ef9d45ac97d1da754c66982c'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.077974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1439/2874] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:05 2022] DELETE /identity/v3/users/81e717a1ef9d45ac97d1da754c66982c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:06.085074 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:06.085752 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:06.086287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:06.114173 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:06.115513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:06.167306 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=100 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:06.192961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1436/2875] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:06.205941 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:06.207563 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:06.282033 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b382f7-d43c-4992-be90-d064ac3ed432 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:06.285850 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:06.286521 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:06.286801 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:06.287072 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:06.300385 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:06.302852 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:06.321794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1440/2876] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:06.650532 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:06.653264 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:06.679038 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792acd9-6998-4ca0-892e-6ac14176a9ee None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:06.686795 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:06.687457 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:06.687732 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:06.688005 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] PATH_INFO: `/v3/projects/885d49d8aa0743c5a6bffe19bc5f2edc` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:06.691107 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=885d49d8aa0743c5a6bffe19bc5f2edc)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:06.700445 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:06.769322 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885d49d8aa0743c5a6bffe19bc5f2edc', 'request_id': 'req-8fe16a07-d71f-462b-87b8-ec5c4c91f678'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.780769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885d49d8aa0743c5a6bffe19bc5f2edc', 'request_id': 'req-8fe16a07-d71f-462b-87b8-ec5c4c91f678'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.788210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885d49d8aa0743c5a6bffe19bc5f2edc', 'request_id': 'req-8fe16a07-d71f-462b-87b8-ec5c4c91f678'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.800622 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] The token cache is being invalidate because project 885d49d8aa0743c5a6bffe19bc5f2edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:06.801294 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.802671 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.804524 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1437/2877] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:06 2022] DELETE /identity/v3/projects/885d49d8aa0743c5a6bffe19bc5f2edc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:06.810792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:06.822606 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466aad7-0637-4e86-a0f9-98d944b557cc service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:06.846997 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:06.898049 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:06.898886 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:06.899173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:06.899447 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] PATH_INFO: `/v3/users/ab4ec3cf83984c94a5a04b43316c1861` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:06.900927 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4ec3cf83984c94a5a04b43316c1861)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:06.902992 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:06.982102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4ec3cf83984c94a5a04b43316c1861'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:06.999189 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4ec3cf83984c94a5a04b43316c1861'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.007976 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4ec3cf83984c94a5a04b43316c1861'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.009186 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4ec3cf83984c94a5a04b43316c1861'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.020266 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-20e56729-d217-479c-85f6-22a0794206d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4ec3cf83984c94a5a04b43316c1861'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.028238 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1441/2878] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:06 2022] DELETE /identity/v3/users/ab4ec3cf83984c94a5a04b43316c1861 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:07.383398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:07.384895 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:07.404325 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe16a07-d71f-462b-87b8-ec5c4c91f678 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:07.499169 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:07.499940 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:07.500279 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:07.500666 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] PATH_INFO: `/v3/projects/d3fc36c31e4247719c2e10ff4c556e32` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:07.501807 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3fc36c31e4247719c2e10ff4c556e32)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:07.503753 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:07.562931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3fc36c31e4247719c2e10ff4c556e32', 'request_id': 'req-155ab85a-3042-4655-aef8-f081734f9eb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.571552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3fc36c31e4247719c2e10ff4c556e32', 'request_id': 'req-155ab85a-3042-4655-aef8-f081734f9eb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.580409 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3fc36c31e4247719c2e10ff4c556e32', 'request_id': 'req-155ab85a-3042-4655-aef8-f081734f9eb8'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.590408 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:07.595749 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] The token cache is being invalidate because project d3fc36c31e4247719c2e10ff4c556e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:07.596148 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.599344 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-155ab85a-3042-4655-aef8-f081734f9eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:07.606219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1438/2879] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:07 2022] DELETE /identity/v3/projects/d3fc36c31e4247719c2e10ff4c556e32 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:07.607832 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add23a9-8479-4125-bae5-69963f0b0d4c None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:07.608224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add23a9-8479-4125-bae5-69963f0b0d4c None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:07.608509 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add23a9-8479-4125-bae5-69963f0b0d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:07.632276 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-8add23a9-8479-4125-bae5-69963f0b0d4c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:07.633648 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-8add23a9-8479-4125-bae5-69963f0b0d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:07.712210 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1442/2880] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:07.715319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca9e0-28de-42c2-9ebe-fe08e11e5db0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:07.716391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca9e0-28de-42c2-9ebe-fe08e11e5db0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:07.716676 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca9e0-28de-42c2-9ebe-fe08e11e5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:07.739696 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-48dca9e0-28de-42c2-9ebe-fe08e11e5db0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:07.740937 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-48dca9e0-28de-42c2-9ebe-fe08e11e5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:07.753113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1439/2881] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:07.754443 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add23a9-8479-4125-bae5-69963f0b0d4c None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:07.765496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add23a9-8479-4125-bae5-69963f0b0d4c None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:07.772144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:07.772144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:07.772144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:07.772144 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:07.772819 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:41:07.773169 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:07.774891 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:07.789495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1443/2882] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:41:07.795113 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca9e0-28de-42c2-9ebe-fe08e11e5db0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:07.805593 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca9e0-28de-42c2-9ebe-fe08e11e5db0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:07.810873 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:07.811557 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:07.811910 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:07.812248 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:07.813015 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:07.819554 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:07.854168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1440/2883] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:41:07 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:07.859793 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:07.874571 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12168554-b174-4553-a98a-5ff7f34fda0a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:07.888652 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:07.951123 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:07.952533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:07.952533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:07.952533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:07.954782 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:07.954946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:08.005818 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1444/2884] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:41:07 2022] POST /identity/v3/users => generated 281 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:08.011303 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:08.024934 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe826c7-381f-4130-b41a-736e9bd5f61d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:08.031472 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:08.032137 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.032419 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.032717 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.033383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:08.035055 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:08.051399 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:08.052493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1441/2885] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:08.066292 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1431-bd6a-49ff-aa28-9290e0c9da22 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:08.068813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6699ae4-0f89-4368-840d-a1acdf81553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:08.069485 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ae4-0f89-4368-840d-a1acdf81553f admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.069768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ae4-0f89-4368-840d-a1acdf81553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.070046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699ae4-0f89-4368-840d-a1acdf81553f admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.070740 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699ae4-0f89-4368-840d-a1acdf81553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:08.072428 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6699ae4-0f89-4368-840d-a1acdf81553f admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:08.091924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1445/2886] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 08:41:08.097152 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:08.108860 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5d733-4f36-4568-8fd1-3785859d7065 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:08.116529 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:08.117812 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.118641 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.119177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] PATH_INFO: `/v3/projects/24b5c5c13a7c4d82bddae1d64c69c1aa/users/a3fb01b243bf4ba29ced9e041b8661d3/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.141513 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b5c5c13a7c4d82bddae1d64c69c1aa, user_id=a3fb01b243bf4ba29ced9e041b8661d3, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:08.144634 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:08.178377 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1442/2887] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:41:08 2022] PUT /identity/v3/projects/24b5c5c13a7c4d82bddae1d64c69c1aa/users/a3fb01b243bf4ba29ced9e041b8661d3/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:08.182688 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6265-6f80-4ff3-9e1c-dfe3dfbd5551 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.183023 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6265-6f80-4ff3-9e1c-dfe3dfbd5551 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.183302 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e6265-6f80-4ff3-9e1c-dfe3dfbd5551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.227869 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-029e6265-6f80-4ff3-9e1c-dfe3dfbd5551 None None] MFA Rules not processed for user `a3fb01b243bf4ba29ced9e041b8661d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:08.229476 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-029e6265-6f80-4ff3-9e1c-dfe3dfbd5551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:08.329690 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1446/2888] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:08.384664 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:08.389104 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:08.473574 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6bc43-7f9c-43e7-9f93-ef5c39b60424 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:08.478413 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b418fb-8e6d-4db5-86d5-f92141924539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:08.479736 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b418fb-8e6d-4db5-86d5-f92141924539 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.480166 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b418fb-8e6d-4db5-86d5-f92141924539 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.480552 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b418fb-8e6d-4db5-86d5-f92141924539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.496631 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b418fb-8e6d-4db5-86d5-f92141924539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:08.498289 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b418fb-8e6d-4db5-86d5-f92141924539 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:08.513102 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1443/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:41:08.563366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6265-6f80-4ff3-9e1c-dfe3dfbd5551 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:08.695680 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e6265-6f80-4ff3-9e1c-dfe3dfbd5551 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:08.701285 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:08.701932 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.702225 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.702525 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] PATH_INFO: `/v3/users/a3fb01b243bf4ba29ced9e041b8661d3` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.703667 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3fb01b243bf4ba29ced9e041b8661d3)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:08.705763 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:08.742213 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:08.768952 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3fb01b243bf4ba29ced9e041b8661d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:08.786061 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3fb01b243bf4ba29ced9e041b8661d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:08.794565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3fb01b243bf4ba29ced9e041b8661d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:08.796118 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3fb01b243bf4ba29ced9e041b8661d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:08.807284 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3fb01b243bf4ba29ced9e041b8661d3'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:08.815569 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1447/2890] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:08 2022] DELETE /identity/v3/users/a3fb01b243bf4ba29ced9e041b8661d3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:08.821120 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:08.821430 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:08.821864 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:08.845769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:08.847293 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:08.923778 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1444/2891] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:41:08.936247 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:08.938526 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:09.026812 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581fb2d-9d26-4d62-82de-2a2bc416fdd1 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:09.033682 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1b888-e030-4729-be11-6137cdb3f785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:09.036663 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b888-e030-4729-be11-6137cdb3f785 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:09.036974 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b888-e030-4729-be11-6137cdb3f785 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:09.037256 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b888-e030-4729-be11-6137cdb3f785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:09.048863 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1b888-e030-4729-be11-6137cdb3f785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:09.050665 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1b888-e030-4729-be11-6137cdb3f785 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:09.064671 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1448/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:09.414508 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:09.416706 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:09.437678 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c5cd7-f602-4a82-a67d-f886882bdf8c None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:09.443295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:09.444075 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:09.444516 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:09.444801 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] PATH_INFO: `/v3/projects/24b5c5c13a7c4d82bddae1d64c69c1aa` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:09.446168 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b5c5c13a7c4d82bddae1d64c69c1aa)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:09.448565 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:09.499761 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:09.514743 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b5c5c13a7c4d82bddae1d64c69c1aa', 'request_id': 'req-051fcfcb-e487-471e-8553-6fad88976a0f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:09.523727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b5c5c13a7c4d82bddae1d64c69c1aa', 'request_id': 'req-051fcfcb-e487-471e-8553-6fad88976a0f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:09.531091 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b5c5c13a7c4d82bddae1d64c69c1aa', 'request_id': 'req-051fcfcb-e487-471e-8553-6fad88976a0f'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:09.547727 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] The token cache is being invalidate because project 24b5c5c13a7c4d82bddae1d64c69c1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:09.548014 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:09.548687 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:09.550170 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1445/2893] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:09 2022] DELETE /identity/v3/projects/24b5c5c13a7c4d82bddae1d64c69c1aa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:16.307582 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:16.308069 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:16.308165 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:16.326904 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] MFA Rules not processed for user `5c37924aa7154c619adb78b69922b333`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:16.328130 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:16.385612 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1449/2894] 10.222.0.36 () {58 vars in 967 bytes} [Thu Sep 1 08:41:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:16.397858 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:16.399297 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:16.474907 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fcfcb-e487-471e-8553-6fad88976a0f admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:16.479899 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '631f5f7d18ab4574843a667ef17429ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:16.480505 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:16.480781 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:16.481056 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:16.489692 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:16.491313 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:16.500785 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1446/2895] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Sep 1 08:41:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 08:41:17.926765 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:17.928221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:17.986166 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8135c-7d8f-4f8c-a4d8-421d2b520c76 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:17.989768 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:17.990412 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:17.990696 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:17.990972 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:17.992713 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:17.997918 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:18.058221 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:18.059693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:18.069565 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1450/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:18.524996 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:18.527320 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:18.589496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:18.591095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:18.609062 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736ddfa-c35f-42c6-8613-bd451b2ca934 service swift] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:18.610265 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa00cdd-75c0-44ec-9987-095730874045 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:18.614560 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:18.615046 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:18.615162 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:18.615437 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:18.615673 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:18.615775 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:18.615955 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:18.616235 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] PATH_INFO: `/v3/users/fa1a7528481748199f4b610cac89a0bc` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:18.617359 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1a7528481748199f4b610cac89a0bc)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:18.617483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:18.619346 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:18.630369 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:18.632177 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:18.643861 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1447/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:18.674760 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1a7528481748199f4b610cac89a0bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:18.690183 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1a7528481748199f4b610cac89a0bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:18.697124 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1a7528481748199f4b610cac89a0bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:18.698342 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1a7528481748199f4b610cac89a0bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:18.705655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f20dde05-a9fc-4697-ba2f-a41c82a5e4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1a7528481748199f4b610cac89a0bc'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:18.711624 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1451/2898] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:18 2022] DELETE /identity/v3/users/fa1a7528481748199f4b610cac89a0bc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:18.891261 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:18.902793 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed357a-2aae-4208-a4c1-56e49a81d1b4 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:18.944232 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:18.962768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:18.963553 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:18.963691 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:18.963941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] PATH_INFO: `/v3/projects/d4b39154c71145fab74e8609b0c6bc11` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:18.965034 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b39154c71145fab74e8609b0c6bc11)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:18.966990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.012382 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b39154c71145fab74e8609b0c6bc11', 'request_id': 'req-53bbf553-c900-4934-bcf9-c717a162c338'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:19.019387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b39154c71145fab74e8609b0c6bc11', 'request_id': 'req-53bbf553-c900-4934-bcf9-c717a162c338'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:19.025558 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b39154c71145fab74e8609b0c6bc11', 'request_id': 'req-53bbf553-c900-4934-bcf9-c717a162c338'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:19.035804 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] The token cache is being invalidate because project d4b39154c71145fab74e8609b0c6bc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:19.036089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:19.036823 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-53bbf553-c900-4934-bcf9-c717a162c338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:19.038575 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1448/2899] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:18 2022] DELETE /identity/v3/projects/d4b39154c71145fab74e8609b0c6bc11 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:19.043616 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbad06-c948-4ff3-b549-07b1309c9240 None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.044067 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbad06-c948-4ff3-b549-07b1309c9240 None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.044173 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbad06-c948-4ff3-b549-07b1309c9240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.064045 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-d8bbad06-c948-4ff3-b549-07b1309c9240 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:19.065244 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-d8bbad06-c948-4ff3-b549-07b1309c9240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:19.125892 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1452/2900] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:19.136174 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e952dde-cc79-48b1-b53e-2d04f073d6a0 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.138037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e952dde-cc79-48b1-b53e-2d04f073d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.138037 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e952dde-cc79-48b1-b53e-2d04f073d6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.156915 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-6e952dde-cc79-48b1-b53e-2d04f073d6a0 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:19.158111 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-6e952dde-cc79-48b1-b53e-2d04f073d6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:19.167060 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1449/2901] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:19.175487 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbad06-c948-4ff3-b549-07b1309c9240 None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:19.184081 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbad06-c948-4ff3-b549-07b1309c9240 None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:19.190010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:19.190915 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.191374 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.191722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.192535 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81643) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 08:41:19.192908 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:19.194857 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.204799 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:19.209171 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1453/2902] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Sep 1 08:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 08:41:19.213214 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e952dde-cc79-48b1-b53e-2d04f073d6a0 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:19.222652 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e952dde-cc79-48b1-b53e-2d04f073d6a0 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:19.227319 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:19.227941 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.228219 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.228493 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.230087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:19.232023 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.262796 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1450/2903] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Sep 1 08:41:19 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:19.266693 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:19.277640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70c444-185d-4990-a5cf-f67e2a09cfc9 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:19.335939 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:19.336551 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.337099 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.337369 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] PATH_INFO: `/v3/users` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.338031 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:19.340146 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.362079 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1454/2904] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Sep 1 08:41:19 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 08:41:19.366200 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:19.377371 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864e33e-47d8-423b-98e1-203f4e0f04b1 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:19.382043 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:19.382679 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.382962 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.383241 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.383891 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:19.385701 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.395788 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1451/2905] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:19.399810 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:19.412914 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb33dd-67d1-4daa-96a1-128d770cdc99 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:19.420160 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f8c1f-a02c-4c1a-87e5-2f12d53e50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:19.420792 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8c1f-a02c-4c1a-87e5-2f12d53e50e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.421036 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8c1f-a02c-4c1a-87e5-2f12d53e50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.421533 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f8c1f-a02c-4c1a-87e5-2f12d53e50e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.424257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f8c1f-a02c-4c1a-87e5-2f12d53e50e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:19.424257 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f8c1f-a02c-4c1a-87e5-2f12d53e50e6 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.559798 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1455/2906] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Sep 1 08:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 08:41:19.564125 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:19.575115 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b49b3-3bd1-4a5a-9f95-d17ce4fbc514 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:19.579751 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:19.580394 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] REQUEST_METHOD: `PUT` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.580673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.580980 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] PATH_INFO: `/v3/projects/62253c58f4a04cbbb41e24146b25af30/users/67b2fb08523745d1bb10df079e621f91/roles/2d6361445523491fb757e0b12f225dcb` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.597410 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62253c58f4a04cbbb41e24146b25af30, user_id=67b2fb08523745d1bb10df079e621f91, role_id=2d6361445523491fb757e0b12f225dcb)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:19.600114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.614312 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1452/2907] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Sep 1 08:41:19 2022] PUT /identity/v3/projects/62253c58f4a04cbbb41e24146b25af30/users/67b2fb08523745d1bb10df079e621f91/roles/2d6361445523491fb757e0b12f225dcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:19.626264 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bb9c8-60eb-4f69-a320-e327e89a0d7d None None] REQUEST_METHOD: `POST` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.626564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bb9c8-60eb-4f69-a320-e327e89a0d7d None None] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.626841 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bb9c8-60eb-4f69-a320-e327e89a0d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.654881 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.auth.core [None req-bc8bb9c8-60eb-4f69-a320-e327e89a0d7d None None] MFA Rules not processed for user `67b2fb08523745d1bb10df079e621f91`. Rule list: `[]` (Enabled: `True`). {{(pid=81643) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:19.656094 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-bc8bb9c8-60eb-4f69-a320-e327e89a0d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:19.719594 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1456/2908] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 08:41:19.733039 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:19.734786 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:19.800702 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634eeaf3-3dd8-4d33-81a4-23e5771d243d admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:19.805295 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca05534-ba45-4e2e-9f1d-17a2ba37bcd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146b6b09371b4deb940ad1fb924ea984', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:19.806001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca05534-ba45-4e2e-9f1d-17a2ba37bcd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:19.806555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca05534-ba45-4e2e-9f1d-17a2ba37bcd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:19.806555 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca05534-ba45-4e2e-9f1d-17a2ba37bcd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:19.817383 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca05534-ba45-4e2e-9f1d-17a2ba37bcd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:19.818782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca05534-ba45-4e2e-9f1d-17a2ba37bcd7 service cinder] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:19.828768 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1453/2909] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:29.716591 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:29.824756 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:29.992640 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bb9c8-60eb-4f69-a320-e327e89a0d7d None None] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:30.053176 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bb9c8-60eb-4f69-a320-e327e89a0d7d None None] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:30.057726 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:30.058379 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:30.058655 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:30.058924 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] PATH_INFO: `/v3/users/67b2fb08523745d1bb10df079e621f91` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:30.060102 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b2fb08523745d1bb10df079e621f91)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:30.061966 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:30.107275 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b2fb08523745d1bb10df079e621f91'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.119095 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b2fb08523745d1bb10df079e621f91'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.125646 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b2fb08523745d1bb10df079e621f91'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.126358 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b2fb08523745d1bb10df079e621f91'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.133321 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b2fb08523745d1bb10df079e621f91'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.139592 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1457/2910] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:41:29 2022] DELETE /identity/v3/users/67b2fb08523745d1bb10df079e621f91 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:30.144114 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] REQUEST_METHOD: `POST` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:30.144398 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:30.144673 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:30.163656 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.auth.core [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] MFA Rules not processed for user `8d1271b1c1034e5fb48b3fb098c1b6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81642) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 08:41:30.164839 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:30.225354 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1454/2911] 10.222.0.36 () {58 vars in 958 bytes} [Thu Sep 1 08:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 08:41:30.235794 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:30.237218 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:30.297779 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974dfc6-2c8f-41eb-8bc3-c077523ec39a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:30.301514 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:30.302121 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:30.302434 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:30.302698 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:30.312388 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:30.313833 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:30.324949 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1458/2912] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:41:30.594339 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:41:30.595992 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:41:30.610040 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726a47-0bba-4607-82be-470c723a5fe8 None None] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:41:30.615089 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:41:30.615721 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:41:30.616001 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:41:30.616274 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] PATH_INFO: `/v3/projects/62253c58f4a04cbbb41e24146b25af30` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:41:30.617424 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=62253c58f4a04cbbb41e24146b25af30)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:41:30.620770 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:41:30.670589 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62253c58f4a04cbbb41e24146b25af30', 'request_id': 'req-ae1f08f9-7592-4b88-b412-e2e698d3f27e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.678042 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62253c58f4a04cbbb41e24146b25af30', 'request_id': 'req-ae1f08f9-7592-4b88-b412-e2e698d3f27e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.685829 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62253c58f4a04cbbb41e24146b25af30', 'request_id': 'req-ae1f08f9-7592-4b88-b412-e2e698d3f27e'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.696481 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] The token cache is being invalidate because project 62253c58f4a04cbbb41e24146b25af30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:41:30.696769 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.697608 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:41:30.699255 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1455/2913] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:41:30 2022] DELETE /identity/v3/projects/62253c58f4a04cbbb41e24146b25af30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:41:40.319495 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:41:40.693379 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:17.213602 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:42:17.223317 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf8437-5d52-4925-b400-ed3d09313dc5 service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:42:17.272363 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43048122a82e4562babb240ff090d5f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:42:17.272969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:42:17.273242 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:42:17.273512 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:42:17.275343 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:42:17.338930 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:42:17.340366 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:42:17.350695 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1459/2914] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:42:20.405016 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:42:20.407487 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:42:20.507414 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f08f9-7592-4b88-b412-e2e698d3f27e admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:42:20.512521 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:42:20.513136 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] REQUEST_METHOD: `GET` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:42:20.513418 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:42:20.513698 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:42:20.516205 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:42:20.528222 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:42:20.529961 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:42:20.541209 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1456/2915] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:42:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 08:42:23.772477 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:42:23.774003 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:42:23.788016 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c8a34-eab7-4275-b580-0d4c82d4a14c service neutron] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:42:23.792111 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:42:23.792743 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:42:23.793022 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:42:23.793362 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] PATH_INFO: `/v3/users/65d25899f57a40a19ebbceea38aa396b` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:42:23.794522 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d25899f57a40a19ebbceea38aa396b)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:42:23.797154 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:42:23.847150 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d25899f57a40a19ebbceea38aa396b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:23.859999 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d25899f57a40a19ebbceea38aa396b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:23.866813 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d25899f57a40a19ebbceea38aa396b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:23.867524 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d25899f57a40a19ebbceea38aa396b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:23.875604 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d25899f57a40a19ebbceea38aa396b'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:23.881564 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1460/2916] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:42:23 2022] DELETE /identity/v3/users/65d25899f57a40a19ebbceea38aa396b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:42:24.056515 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:42:24.073391 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bfe4-6bda-4776-ada4-a1a5fa8cd4d1 service placement] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:42:24.131806 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:42:24.132435 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:42:24.132718 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:42:24.133000 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] PATH_INFO: `/v3/projects/39afc2ba4f5b483f916fd0d229b76818` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:42:24.134186 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39afc2ba4f5b483f916fd0d229b76818)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:42:24.136145 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:42:24.183287 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39afc2ba4f5b483f916fd0d229b76818', 'request_id': 'req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.190665 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39afc2ba4f5b483f916fd0d229b76818', 'request_id': 'req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.196815 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39afc2ba4f5b483f916fd0d229b76818', 'request_id': 'req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.207663 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] The token cache is being invalidate because project 39afc2ba4f5b483f916fd0d229b76818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:42:24.207945 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.208592 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.210067 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1457/2917] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:42:24 2022] DELETE /identity/v3/projects/39afc2ba4f5b483f916fd0d229b76818 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:42:24.214548 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:42:24.215791 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:42:24.229552 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c864de2-93f0-4dc1-985e-482fe648d595 admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:42:24.249332 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:24.293725 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:42:24.294406 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:42:24.294691 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:42:24.294969 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] PATH_INFO: `/v3/users/cc62dec9fae04e539001eff0812441f8` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:42:24.296119 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc62dec9fae04e539001eff0812441f8)` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:42:24.298134 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:42:24.348496 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc62dec9fae04e539001eff0812441f8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.360414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc62dec9fae04e539001eff0812441f8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.367050 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc62dec9fae04e539001eff0812441f8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.367733 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc62dec9fae04e539001eff0812441f8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.374516 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.notifications [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc62dec9fae04e539001eff0812441f8'} {{(pid=81643) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.380382 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1461/2918] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Sep 1 08:42:24 2022] DELETE /identity/v3/users/cc62dec9fae04e539001eff0812441f8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:42:24.553782 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Authenticating user token {{(pid=81642) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:42:24.555216 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.fernet_utils [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81642) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:42:24.569990 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e33ea0-c90a-495e-b1e7-e7d21f17a939 admin admin] Validating token access rules against request {{(pid=81642) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:42:24.591694 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:24.635387 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d1271b1c1034e5fb48b3fb098c1b6b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7901ef731efb4e4d9c32801133aae298', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81642) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:42:24.635927 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:42:24.636210 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:42:24.636483 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] PATH_INFO: `/v3/projects/c651c3be4a6e4966aeb726f2538c630b` {{(pid=81642) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:42:24.637604 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c651c3be4a6e4966aeb726f2538c630b)` {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:42:24.639611 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] RBAC: Authorization granted {{(pid=81642) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:42:24.688486 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c651c3be4a6e4966aeb726f2538c630b', 'request_id': 'req-627c7270-1674-4fc6-88bf-25fe33bb27e2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.695750 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c651c3be4a6e4966aeb726f2538c630b', 'request_id': 'req-627c7270-1674-4fc6-88bf-25fe33bb27e2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.702069 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c651c3be4a6e4966aeb726f2538c630b', 'request_id': 'req-627c7270-1674-4fc6-88bf-25fe33bb27e2'} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.712639 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] The token cache is being invalidate because project c651c3be4a6e4966aeb726f2538c630b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81642) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 08:42:24.712931 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.713577 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG keystone.notifications [None req-627c7270-1674-4fc6-88bf-25fe33bb27e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81642) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 08:42:24.715087 dv-cinder-855479-1-smb devstack@keystone.service[81642]: [pid: 81642|app: 0|req: 1458/2919] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Sep 1 08:42:24 2022] DELETE /identity/v3/projects/c651c3be4a6e4966aeb726f2538c630b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 08:42:34.376946 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:42:34.709415 dv-cinder-855479-1-smb devstack@keystone.service[81642]: DEBUG dbcounter [-] [81642] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81642) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 08:44:59.434268 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Authenticating user token {{(pid=81643) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 08:44:59.435722 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:44:59.561747 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece46e1-98be-4adc-92d1-196fb0d3e96a admin admin] Validating token access rules against request {{(pid=81643) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 08:44:59.623224 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10323fe-ef18-4a1d-95f0-aff9f79fe4a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b056c355c8b4959b5808cc22304e36d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b77ce5545b134888bb724ed6f37a6a12', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81643) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 08:44:59.623835 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10323fe-ef18-4a1d-95f0-aff9f79fe4a1 service placement] REQUEST_METHOD: `GET` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 08:44:59.624116 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10323fe-ef18-4a1d-95f0-aff9f79fe4a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 08:44:59.624414 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10323fe-ef18-4a1d-95f0-aff9f79fe4a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81643) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 08:44:59.626724 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.fernet_utils [None req-f10323fe-ef18-4a1d-95f0-aff9f79fe4a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81643) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 08:44:59.638227 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10323fe-ef18-4a1d-95f0-aff9f79fe4a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 08:44:59.639834 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10323fe-ef18-4a1d-95f0-aff9f79fe4a1 service placement] RBAC: Authorization granted {{(pid=81643) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 08:44:59.650440 dv-cinder-855479-1-smb devstack@keystone.service[81643]: [pid: 81643|app: 0|req: 1462/2920] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Sep 1 08:44:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 08:45:09.646010 dv-cinder-855479-1-smb devstack@keystone.service[81643]: DEBUG dbcounter [-] [81643] Writing DB stats keystone:SELECT=82 {{(pid=81643) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}